Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 880265 Details for
Bug 1082275
[MultiHost] Bridge still exists for the network when updating that network to be non-VM (net over bond)
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log with sw1 as problematic network
vdsm.log (text/x-log), 1.40 MB, created by
GenadiC
on 2014-03-30 08:22:46 UTC
(
hide
)
Description:
vdsm log with sw1 as problematic network
Filename:
MIME Type:
Creator:
GenadiC
Created:
2014-03-30 08:22:46 UTC
Size:
1.40 MB
patch
obsolete
>BindingXMLRPC::ERROR::2014-03-30 11:01:01,352::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:02,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:02,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537841 s, 19.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:01:03,150::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:01:03,164::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00120603 s, 287 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:04,369::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:04,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:05,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.03704 s, 987 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:07,381::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:07,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:07,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0591142 s, 17.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:01:08,648::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:01:08,649::task::595::TaskManager.Task::(_updateState) Task=`5bdf953a-d207-4339-ad40-295f9b659653`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:01:08,649::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:01:08,686::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:01:08,686::task::1185::TaskManager.Task::(prepare) Task=`5bdf953a-d207-4339-ad40-295f9b659653`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:01:08,687::task::595::TaskManager.Task::(_updateState) Task=`5bdf953a-d207-4339-ad40-295f9b659653`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:01:08,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:01:08,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:01:08,687::task::990::TaskManager.Task::(_decref) Task=`5bdf953a-d207-4339-ad40-295f9b659653`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:01:08,693::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:01:08,694::task::595::TaskManager.Task::(_updateState) Task=`43da95d0-dc66-4086-adcf-8006f5c6ec0d`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:01:08,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:01:08,694::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`227ad098-91b8-4df6-90bd-0fa5813ceef7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:01:08,694::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:01:08,695::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:01:08,695::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`227ad098-91b8-4df6-90bd-0fa5813ceef7`::Granted request >Thread-236::DEBUG::2014-03-30 11:01:08,696::task::827::TaskManager.Task::(resourceAcquired) Task=`43da95d0-dc66-4086-adcf-8006f5c6ec0d`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:01:08,696::task::990::TaskManager.Task::(_decref) Task=`43da95d0-dc66-4086-adcf-8006f5c6ec0d`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:01:08,697::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1988379869184', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:08,697::task::1185::TaskManager.Task::(prepare) Task=`43da95d0-dc66-4086-adcf-8006f5c6ec0d`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1988379869184', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:08,698::task::595::TaskManager.Task::(_updateState) Task=`43da95d0-dc66-4086-adcf-8006f5c6ec0d`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:01:08,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:01:08,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:01:08,698::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:01:08,698::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:01:08,698::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:01:08,699::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:01:08,699::task::990::TaskManager.Task::(_decref) Task=`43da95d0-dc66-4086-adcf-8006f5c6ec0d`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:01:09,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:10,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552092 s, 18.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:10,401::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:01:10,867::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:01:10,884::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00454529 s, 901 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:12,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:12,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552068 s, 18.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:01:13,175::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:01:13,186::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000415056 s, 834 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:13,415::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:14,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:14,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054604 s, 18.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:01:14,587::task::595::TaskManager.Task::(_updateState) Task=`4ec013f3-b779-4e9c-b386-1ac890eec704`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:01:14,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:01:14,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00454529', 'lastCheck': '3.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415056', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:01:14,588::task::1185::TaskManager.Task::(prepare) Task=`4ec013f3-b779-4e9c-b386-1ac890eec704`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00454529', 'lastCheck': '3.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415056', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:01:14,588::task::595::TaskManager.Task::(_updateState) Task=`4ec013f3-b779-4e9c-b386-1ac890eec704`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:01:14,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:01:14,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:01:14,589::task::990::TaskManager.Task::(_decref) Task=`4ec013f3-b779-4e9c-b386-1ac890eec704`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:01:16,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:01:16,431::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:17,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.01025 s, 1.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:01:18,721::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:01:18,721::task::595::TaskManager.Task::(_updateState) Task=`0cb2c083-161e-42bf-9ee6-637bdba9f595`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:01:18,722::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:01:18,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:01:18,758::task::1185::TaskManager.Task::(prepare) Task=`0cb2c083-161e-42bf-9ee6-637bdba9f595`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:01:18,758::task::595::TaskManager.Task::(_updateState) Task=`0cb2c083-161e-42bf-9ee6-637bdba9f595`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:01:18,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:01:18,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:01:18,758::task::990::TaskManager.Task::(_decref) Task=`0cb2c083-161e-42bf-9ee6-637bdba9f595`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:01:18,764::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:01:18,764::task::595::TaskManager.Task::(_updateState) Task=`3dd823fb-dfed-4ac0-a5e7-a574d7d09bd8`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:01:18,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:01:18,765::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`75eeadb2-c6b2-491b-a938-fedfa6c1f718`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:01:18,765::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:01:18,765::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:01:18,765::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`75eeadb2-c6b2-491b-a938-fedfa6c1f718`::Granted request >Thread-236::DEBUG::2014-03-30 11:01:18,766::task::827::TaskManager.Task::(resourceAcquired) Task=`3dd823fb-dfed-4ac0-a5e7-a574d7d09bd8`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:01:18,766::task::990::TaskManager.Task::(_decref) Task=`3dd823fb-dfed-4ac0-a5e7-a574d7d09bd8`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:01:18,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1988090920960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:18,767::task::1185::TaskManager.Task::(prepare) Task=`3dd823fb-dfed-4ac0-a5e7-a574d7d09bd8`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1988090920960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:18,767::task::595::TaskManager.Task::(_updateState) Task=`3dd823fb-dfed-4ac0-a5e7-a574d7d09bd8`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:01:18,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:01:18,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:01:18,768::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:01:18,768::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:01:18,768::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:01:18,768::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:01:18,768::task::990::TaskManager.Task::(_decref) Task=`3dd823fb-dfed-4ac0-a5e7-a574d7d09bd8`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:01:19,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:01:19,451::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:19,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503006 s, 20.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:01:20,892::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:01:20,910::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00603075 s, 679 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:21,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:21,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713591 s, 14.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:22,469::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:01:23,197::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:01:23,209::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000408704 s, 847 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:23,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:23,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.060114 s, 17.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:25,484::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:25,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:25,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541019 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:27,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:28,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049401 s, 20.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:28,503::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:01:28,792::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-13::DEBUG::2014-03-30 11:01:28,792::task::595::TaskManager.Task::(_updateState) Task=`567c4c27-0e72-4a59-b2c5-e8cf72c60aa0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:01:28,793::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::DEBUG::2014-03-30 11:01:29,748::task::595::TaskManager.Task::(_updateState) Task=`d9be2573-6f76-470c-b423-b3d5380f006e`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:01:29,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:01:29,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00603075', 'lastCheck': '8.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408704', 'lastCheck': '6.5', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:01:29,748::task::1185::TaskManager.Task::(prepare) Task=`d9be2573-6f76-470c-b423-b3d5380f006e`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00603075', 'lastCheck': '8.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000408704', 'lastCheck': '6.5', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:01:29,749::task::595::TaskManager.Task::(_updateState) Task=`d9be2573-6f76-470c-b423-b3d5380f006e`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:01:29,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:01:29,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:01:29,749::task::990::TaskManager.Task::(_decref) Task=`d9be2573-6f76-470c-b423-b3d5380f006e`::ref 0 aborting False >Thread-13::INFO::2014-03-30 11:01:29,785::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:01:29,785::task::1185::TaskManager.Task::(prepare) Task=`567c4c27-0e72-4a59-b2c5-e8cf72c60aa0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:01:29,785::task::595::TaskManager.Task::(_updateState) Task=`567c4c27-0e72-4a59-b2c5-e8cf72c60aa0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:01:29,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:01:29,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:01:29,786::task::990::TaskManager.Task::(_decref) Task=`567c4c27-0e72-4a59-b2c5-e8cf72c60aa0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:01:29,792::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-236::DEBUG::2014-03-30 11:01:29,793::task::595::TaskManager.Task::(_updateState) Task=`2dd92b9b-8022-4b50-abf9-3fe623d0a86a`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:01:29,793::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:01:29,793::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`08b2738d-6699-4fb9-a111-a59cb2cc208a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:01:29,793::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:01:29,794::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:01:29,794::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`08b2738d-6699-4fb9-a111-a59cb2cc208a`::Granted request >Thread-236::DEBUG::2014-03-30 11:01:29,794::task::827::TaskManager.Task::(resourceAcquired) Task=`2dd92b9b-8022-4b50-abf9-3fe623d0a86a`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:01:29,794::task::990::TaskManager.Task::(_decref) Task=`2dd92b9b-8022-4b50-abf9-3fe623d0a86a`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:01:29,795::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1987390406656', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:29,795::task::1185::TaskManager.Task::(prepare) Task=`2dd92b9b-8022-4b50-abf9-3fe623d0a86a`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1987390406656', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:29,796::task::595::TaskManager.Task::(_updateState) Task=`2dd92b9b-8022-4b50-abf9-3fe623d0a86a`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:01:29,796::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:01:29,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:01:29,796::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:01:29,796::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:01:29,797::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:01:29,797::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:01:29,797::task::990::TaskManager.Task::(_decref) Task=`2dd92b9b-8022-4b50-abf9-3fe623d0a86a`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:01:30,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:30,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0528886 s, 19.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:01:30,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:01:30,941::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00909578 s, 450 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:31,518::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:32,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:32,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709525 s, 14.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:01:33,219::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:01:33,232::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.001285 s, 269 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:34,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:01:34,531::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:35,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.01627 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:37,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:01:37,547::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:37,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459759 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:39,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:39,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438225 s, 23.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:01:39,833::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:01:39,833::task::595::TaskManager.Task::(_updateState) Task=`098f02cf-aa5a-4f03-943e-296699473602`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:01:39,834::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:01:39,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:01:39,877::task::1185::TaskManager.Task::(prepare) Task=`098f02cf-aa5a-4f03-943e-296699473602`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:01:39,877::task::595::TaskManager.Task::(_updateState) Task=`098f02cf-aa5a-4f03-943e-296699473602`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:01:39,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:01:39,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:01:39,878::task::990::TaskManager.Task::(_decref) Task=`098f02cf-aa5a-4f03-943e-296699473602`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:01:39,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:01:39,884::task::595::TaskManager.Task::(_updateState) Task=`080ef94b-9c33-434c-af63-78dcaa1d4821`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:01:39,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:01:39,885::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`578cb53a-a7da-40fa-ba8a-3e0fbd78fa9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:01:39,885::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:01:39,886::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:01:39,886::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`578cb53a-a7da-40fa-ba8a-3e0fbd78fa9f`::Granted request >Thread-236::DEBUG::2014-03-30 11:01:39,886::task::827::TaskManager.Task::(resourceAcquired) Task=`080ef94b-9c33-434c-af63-78dcaa1d4821`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:01:39,887::task::990::TaskManager.Task::(_decref) Task=`080ef94b-9c33-434c-af63-78dcaa1d4821`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:01:39,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986902720512', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:39,888::task::1185::TaskManager.Task::(prepare) Task=`080ef94b-9c33-434c-af63-78dcaa1d4821`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986902720512', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:39,888::task::595::TaskManager.Task::(_updateState) Task=`080ef94b-9c33-434c-af63-78dcaa1d4821`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:01:39,888::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:01:39,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:01:39,889::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:01:39,889::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:01:39,889::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:01:39,889::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:01:39,890::task::990::TaskManager.Task::(_decref) Task=`080ef94b-9c33-434c-af63-78dcaa1d4821`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:01:40,566::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:01:40,950::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:01:41,124::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.161206 s, 25.4 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:41,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:41,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0745911 s, 13.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:01:43,243::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:01:43,255::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000423453 s, 817 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:43,579::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:43,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:44,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0565187 s, 18.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:01:44,895::task::595::TaskManager.Task::(_updateState) Task=`e9b68e63-910f-48d0-bad6-88ff40b9458b`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:01:44,895::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:01:44,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.161206', 'lastCheck': '3.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423453', 'lastCheck': '1.6', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:01:44,896::task::1185::TaskManager.Task::(prepare) Task=`e9b68e63-910f-48d0-bad6-88ff40b9458b`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.161206', 'lastCheck': '3.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000423453', 'lastCheck': '1.6', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:01:44,896::task::595::TaskManager.Task::(_updateState) Task=`e9b68e63-910f-48d0-bad6-88ff40b9458b`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:01:44,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:01:44,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:01:44,897::task::990::TaskManager.Task::(_decref) Task=`e9b68e63-910f-48d0-bad6-88ff40b9458b`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:01:46,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:46,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0590891 s, 17.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:46,598::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:48,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:48,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496702 s, 20.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:49,615::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:01:49,922::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [379768e1] >Thread-28::DEBUG::2014-03-30 11:01:49,923::task::595::TaskManager.Task::(_updateState) Task=`e3c1347c-ac83-487d-b1ab-e1635aaeca51`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:01:49,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:01:49,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:01:49,949::task::1185::TaskManager.Task::(prepare) Task=`e3c1347c-ac83-487d-b1ab-e1635aaeca51`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:01:49,949::task::595::TaskManager.Task::(_updateState) Task=`e3c1347c-ac83-487d-b1ab-e1635aaeca51`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:01:49,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:01:49,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:01:49,950::task::990::TaskManager.Task::(_decref) Task=`e3c1347c-ac83-487d-b1ab-e1635aaeca51`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:01:49,956::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [379768e1] >Thread-236::DEBUG::2014-03-30 11:01:49,956::task::595::TaskManager.Task::(_updateState) Task=`804ff360-b33e-4a0d-835a-ca94e3e7b918`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:01:49,956::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:01:49,957::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0facac86-2c87-4be3-b800-b7e44c61d855`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:01:49,957::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:01:49,957::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:01:49,957::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0facac86-2c87-4be3-b800-b7e44c61d855`::Granted request >Thread-236::DEBUG::2014-03-30 11:01:49,958::task::827::TaskManager.Task::(resourceAcquired) Task=`804ff360-b33e-4a0d-835a-ca94e3e7b918`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:01:49,958::task::990::TaskManager.Task::(_decref) Task=`804ff360-b33e-4a0d-835a-ca94e3e7b918`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:01:49,959::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986569076736', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:49,959::task::1185::TaskManager.Task::(prepare) Task=`804ff360-b33e-4a0d-835a-ca94e3e7b918`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986569076736', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:01:49,960::task::595::TaskManager.Task::(_updateState) Task=`804ff360-b33e-4a0d-835a-ca94e3e7b918`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:01:49,960::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:01:49,960::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:01:49,960::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:01:49,961::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:01:49,961::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:01:49,961::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:01:49,961::task::990::TaskManager.Task::(_decref) Task=`804ff360-b33e-4a0d-835a-ca94e3e7b918`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:01:50,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:50,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0996208 s, 10.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:01:51,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:01:51,330::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.184849 s, 22.2 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:52,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:01:52,630::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:52,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106682 s, 9.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:01:53,267::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:01:53,281::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000891756 s, 388 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:01:54,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:54,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0670791 s, 15.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:55,648::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:56,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:56,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395221 s, 25.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:01:58,666::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:01:58,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:01:59,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473741 s, 21.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:01:59,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:01:59,989::task::595::TaskManager.Task::(_updateState) Task=`60c2dbd9-edac-41f6-9e89-d411b314baed`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:01:59,989::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:02:00,018::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:00,018::task::1185::TaskManager.Task::(prepare) Task=`60c2dbd9-edac-41f6-9e89-d411b314baed`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:00,018::task::595::TaskManager.Task::(_updateState) Task=`60c2dbd9-edac-41f6-9e89-d411b314baed`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:00,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:00,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:00,019::task::990::TaskManager.Task::(_decref) Task=`60c2dbd9-edac-41f6-9e89-d411b314baed`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:02:00,024::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:02:00,024::task::595::TaskManager.Task::(_updateState) Task=`900b9468-021b-4574-95d8-f996b16700e1`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:02:00,024::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:02:00,025::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`7e997211-e011-4cc4-b7d8-103e179e027b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:02:00,025::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:02:00,025::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:02:00,025::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`7e997211-e011-4cc4-b7d8-103e179e027b`::Granted request >Thread-236::DEBUG::2014-03-30 11:02:00,026::task::827::TaskManager.Task::(resourceAcquired) Task=`900b9468-021b-4574-95d8-f996b16700e1`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:02:00,026::task::990::TaskManager.Task::(_decref) Task=`900b9468-021b-4574-95d8-f996b16700e1`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:02:00,027::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986132049920', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:00,027::task::1185::TaskManager.Task::(prepare) Task=`900b9468-021b-4574-95d8-f996b16700e1`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986132049920', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:00,027::task::595::TaskManager.Task::(_updateState) Task=`900b9468-021b-4574-95d8-f996b16700e1`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:02:00,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:02:00,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:02:00,028::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:02:00,028::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:02:00,028::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:02:00,028::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:02:00,028::task::990::TaskManager.Task::(_decref) Task=`900b9468-021b-4574-95d8-f996b16700e1`::ref 0 aborting False >Thread-28::DEBUG::2014-03-30 11:02:00,040::task::595::TaskManager.Task::(_updateState) Task=`8ed16afa-dafb-43cf-8893-6aa2512b5b10`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:00,041::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:02:00,041::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.184849', 'lastCheck': '8.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000891756', 'lastCheck': '6.8', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:00,041::task::1185::TaskManager.Task::(prepare) Task=`8ed16afa-dafb-43cf-8893-6aa2512b5b10`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.184849', 'lastCheck': '8.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000891756', 'lastCheck': '6.8', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:00,041::task::595::TaskManager.Task::(_updateState) Task=`8ed16afa-dafb-43cf-8893-6aa2512b5b10`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:00,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:00,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:00,042::task::990::TaskManager.Task::(_decref) Task=`8ed16afa-dafb-43cf-8893-6aa2512b5b10`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:02:01,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:01,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491914 s, 20.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:02:01,339::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:01,356::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00457104 s, 896 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:01,681::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:03,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:03,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394454 s, 26.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:02:03,374::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:02:03,404::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000509471 s, 679 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:04,697::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:05,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:05,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0597182 s, 17.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:07,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:07,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507939 s, 20.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:07,713::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:09,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:09,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470789 s, 21.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:02:10,074::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:02:10,075::task::595::TaskManager.Task::(_updateState) Task=`3f8fe0ae-c742-4241-bb5f-a94ca460c34b`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:10,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:02:10,106::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:10,106::task::1185::TaskManager.Task::(prepare) Task=`3f8fe0ae-c742-4241-bb5f-a94ca460c34b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:10,106::task::595::TaskManager.Task::(_updateState) Task=`3f8fe0ae-c742-4241-bb5f-a94ca460c34b`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:10,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:10,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:10,107::task::990::TaskManager.Task::(_decref) Task=`3f8fe0ae-c742-4241-bb5f-a94ca460c34b`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:02:10,113::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:02:10,114::task::595::TaskManager.Task::(_updateState) Task=`6a8945a9-ccf6-4856-9238-4e66e2a8e6c1`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:02:10,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:02:10,114::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`03e361c9-39c9-4163-9505-64586621005d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:02:10,115::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:02:10,115::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:02:10,115::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`03e361c9-39c9-4163-9505-64586621005d`::Granted request >Thread-236::DEBUG::2014-03-30 11:02:10,116::task::827::TaskManager.Task::(resourceAcquired) Task=`6a8945a9-ccf6-4856-9238-4e66e2a8e6c1`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:02:10,116::task::990::TaskManager.Task::(_decref) Task=`6a8945a9-ccf6-4856-9238-4e66e2a8e6c1`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:02:10,117::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986716958720', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:10,117::task::1185::TaskManager.Task::(prepare) Task=`6a8945a9-ccf6-4856-9238-4e66e2a8e6c1`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986716958720', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:10,118::task::595::TaskManager.Task::(_updateState) Task=`6a8945a9-ccf6-4856-9238-4e66e2a8e6c1`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:02:10,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:02:10,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:02:10,118::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:02:10,118::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:02:10,119::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:02:10,119::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:02:10,119::task::990::TaskManager.Task::(_decref) Task=`6a8945a9-ccf6-4856-9238-4e66e2a8e6c1`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:02:10,730::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:02:11,365::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:11,383::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00509129 s, 805 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:11,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:11,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549447 s, 18.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:02:13,424::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:02:13,435::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000435303 s, 795 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:13,746::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:13,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:14,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552099 s, 18.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:02:15,194::task::595::TaskManager.Task::(_updateState) Task=`92c83a27-611f-4c52-834c-44100cc14a15`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:15,194::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:02:15,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00509129', 'lastCheck': '3.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000435303', 'lastCheck': '1.8', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:15,195::task::1185::TaskManager.Task::(prepare) Task=`92c83a27-611f-4c52-834c-44100cc14a15`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00509129', 'lastCheck': '3.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000435303', 'lastCheck': '1.8', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:15,195::task::595::TaskManager.Task::(_updateState) Task=`92c83a27-611f-4c52-834c-44100cc14a15`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:15,195::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:15,195::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:15,196::task::990::TaskManager.Task::(_decref) Task=`92c83a27-611f-4c52-834c-44100cc14a15`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:02:16,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:16,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0534316 s, 19.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:16,763::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:18,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:18,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431619 s, 23.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:19,780::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:02:20,149::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:02:20,150::task::595::TaskManager.Task::(_updateState) Task=`ec01aa4c-53f4-46c2-992d-1ad73f2f72a6`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:20,150::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:02:20,291::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:20,292::task::1185::TaskManager.Task::(prepare) Task=`ec01aa4c-53f4-46c2-992d-1ad73f2f72a6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:20,292::task::595::TaskManager.Task::(_updateState) Task=`ec01aa4c-53f4-46c2-992d-1ad73f2f72a6`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:20,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:20,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:20,292::task::990::TaskManager.Task::(_decref) Task=`ec01aa4c-53f4-46c2-992d-1ad73f2f72a6`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:02:20,298::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:02:20,298::task::595::TaskManager.Task::(_updateState) Task=`6ebf50db-17b7-4b77-988b-4f51c762493a`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:02:20,298::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:02:20,300::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3238ee9c-2e18-4dca-8002-7e9530d0145a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:02:20,300::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:02:20,300::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:02:20,301::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3238ee9c-2e18-4dca-8002-7e9530d0145a`::Granted request >Thread-236::DEBUG::2014-03-30 11:02:20,301::task::827::TaskManager.Task::(resourceAcquired) Task=`6ebf50db-17b7-4b77-988b-4f51c762493a`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:02:20,301::task::990::TaskManager.Task::(_decref) Task=`6ebf50db-17b7-4b77-988b-4f51c762493a`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:02:20,302::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986423619584', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:20,302::task::1185::TaskManager.Task::(prepare) Task=`6ebf50db-17b7-4b77-988b-4f51c762493a`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986423619584', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:20,303::task::595::TaskManager.Task::(_updateState) Task=`6ebf50db-17b7-4b77-988b-4f51c762493a`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:02:20,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:02:20,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:02:20,303::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:02:20,304::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:02:20,304::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:02:20,304::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:02:20,304::task::990::TaskManager.Task::(_decref) Task=`6ebf50db-17b7-4b77-988b-4f51c762493a`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:02:20,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:20,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0733668 s, 14.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:02:21,391::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:21,410::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00577986 s, 709 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:22,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:02:22,799::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:02:23,447::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:02:23,459::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000464086 s, 746 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:23,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 1.00905 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:25,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:25,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04769 s, 21.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:25,812::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:27,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:27,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460137 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:28,827::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:29,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:29,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413398 s, 24.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:02:30,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:02:30,333::task::595::TaskManager.Task::(_updateState) Task=`948c3a77-e5f8-40a5-8363-5f048064b380`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:30,333::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:02:30,370::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:30,371::task::1185::TaskManager.Task::(prepare) Task=`948c3a77-e5f8-40a5-8363-5f048064b380`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:30,372::task::595::TaskManager.Task::(_updateState) Task=`948c3a77-e5f8-40a5-8363-5f048064b380`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:30,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:30,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:30,372::task::990::TaskManager.Task::(_decref) Task=`948c3a77-e5f8-40a5-8363-5f048064b380`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:02:30,379::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:02:30,379::task::595::TaskManager.Task::(_updateState) Task=`ce83ff27-0f0a-47aa-bc66-aa70ae9702e2`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:02:30,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:02:30,380::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`fdde82a5-36e7-4003-8b36-daece1cfe4bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:02:30,380::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:02:30,381::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:02:30,381::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`fdde82a5-36e7-4003-8b36-daece1cfe4bc`::Granted request >Thread-236::DEBUG::2014-03-30 11:02:30,381::task::827::TaskManager.Task::(resourceAcquired) Task=`ce83ff27-0f0a-47aa-bc66-aa70ae9702e2`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:02:30,382::task::990::TaskManager.Task::(_decref) Task=`ce83ff27-0f0a-47aa-bc66-aa70ae9702e2`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:02:30,383::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986159017984', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:30,383::task::1185::TaskManager.Task::(prepare) Task=`ce83ff27-0f0a-47aa-bc66-aa70ae9702e2`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1986159017984', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:30,383::task::595::TaskManager.Task::(_updateState) Task=`ce83ff27-0f0a-47aa-bc66-aa70ae9702e2`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:02:30,383::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:02:30,386::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:02:30,386::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:02:30,386::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:02:30,386::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:02:30,387::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:02:30,387::task::990::TaskManager.Task::(_decref) Task=`ce83ff27-0f0a-47aa-bc66-aa70ae9702e2`::ref 0 aborting False >Thread-28::DEBUG::2014-03-30 11:02:30,662::task::595::TaskManager.Task::(_updateState) Task=`83bc02f1-f074-4e63-9d58-8e8e2b173b1c`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:30,663::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:02:30,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00577986', 'lastCheck': '9.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000464086', 'lastCheck': '7.2', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:30,663::task::1185::TaskManager.Task::(prepare) Task=`83bc02f1-f074-4e63-9d58-8e8e2b173b1c`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00577986', 'lastCheck': '9.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000464086', 'lastCheck': '7.2', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:30,663::task::595::TaskManager.Task::(_updateState) Task=`83bc02f1-f074-4e63-9d58-8e8e2b173b1c`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:30,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:30,664::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:30,664::task::990::TaskManager.Task::(_decref) Task=`83bc02f1-f074-4e63-9d58-8e8e2b173b1c`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:02:31,419::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:31,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00508042 s, 806 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:31,843::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:31,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:32,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476875 s, 21.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:02:33,468::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:02:33,479::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000425155 s, 814 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:34,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:34,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552685 s, 18.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:34,861::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:36,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:37,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.992424 s, 1.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:37,877::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:39,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:39,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393308 s, 26.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:02:40,416::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [28feaba] >Thread-28::DEBUG::2014-03-30 11:02:40,418::task::595::TaskManager.Task::(_updateState) Task=`92d3bd32-853f-490a-914c-a0dd2fe52da3`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:40,419::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:02:40,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:40,448::task::1185::TaskManager.Task::(prepare) Task=`92d3bd32-853f-490a-914c-a0dd2fe52da3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:40,448::task::595::TaskManager.Task::(_updateState) Task=`92d3bd32-853f-490a-914c-a0dd2fe52da3`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:40,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:40,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:40,449::task::990::TaskManager.Task::(_decref) Task=`92d3bd32-853f-490a-914c-a0dd2fe52da3`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:02:40,454::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [28feaba] >Thread-236::DEBUG::2014-03-30 11:02:40,455::task::595::TaskManager.Task::(_updateState) Task=`2964f4f5-8e05-4ad6-ba4d-df5367a9b5a9`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:02:40,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:02:40,456::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`870058e0-50aa-4400-b552-16609c299890`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:02:40,456::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:02:40,456::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:02:40,456::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`870058e0-50aa-4400-b552-16609c299890`::Granted request >Thread-236::DEBUG::2014-03-30 11:02:40,457::task::827::TaskManager.Task::(resourceAcquired) Task=`2964f4f5-8e05-4ad6-ba4d-df5367a9b5a9`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:02:40,457::task::990::TaskManager.Task::(_decref) Task=`2964f4f5-8e05-4ad6-ba4d-df5367a9b5a9`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:02:40,458::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985880817664', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:40,458::task::1185::TaskManager.Task::(prepare) Task=`2964f4f5-8e05-4ad6-ba4d-df5367a9b5a9`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985880817664', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:40,460::task::595::TaskManager.Task::(_updateState) Task=`2964f4f5-8e05-4ad6-ba4d-df5367a9b5a9`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:02:40,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:02:40,463::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:02:40,465::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:02:40,469::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:02:40,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:02:40,473::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:02:40,476::task::990::TaskManager.Task::(_decref) Task=`2964f4f5-8e05-4ad6-ba4d-df5367a9b5a9`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:02:40,896::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:41,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:41,484::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:41,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00805548 s, 508 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:41,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814267 s, 12.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:02:43,488::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:02:43,501::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000377439 s, 917 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:43,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:43,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470255 s, 21.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:43,912::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:45,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-28::DEBUG::2014-03-30 11:02:45,839::task::595::TaskManager.Task::(_updateState) Task=`cffefd97-7b5b-4b4f-aea6-fe97de3ed19c`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:45,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:02:45,842::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00805548', 'lastCheck': '4.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377439', 'lastCheck': '2.3', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:45,843::task::1185::TaskManager.Task::(prepare) Task=`cffefd97-7b5b-4b4f-aea6-fe97de3ed19c`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00805548', 'lastCheck': '4.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000377439', 'lastCheck': '2.3', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:02:45,844::task::595::TaskManager.Task::(_updateState) Task=`cffefd97-7b5b-4b4f-aea6-fe97de3ed19c`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:45,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:45,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:45,848::task::990::TaskManager.Task::(_decref) Task=`cffefd97-7b5b-4b4f-aea6-fe97de3ed19c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:02:45,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470829 s, 21.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:46,927::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:47,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:48,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392748 s, 26.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:49,943::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:50,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:50,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470557 s, 21.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:02:50,513::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4ed70837] >Thread-28::DEBUG::2014-03-30 11:02:50,514::task::595::TaskManager.Task::(_updateState) Task=`a7fbd8d2-0ac8-4156-81f4-5b50f614ad2d`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:02:50,515::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:02:50,555::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:50,555::task::1185::TaskManager.Task::(prepare) Task=`a7fbd8d2-0ac8-4156-81f4-5b50f614ad2d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:02:50,555::task::595::TaskManager.Task::(_updateState) Task=`a7fbd8d2-0ac8-4156-81f4-5b50f614ad2d`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:02:50,556::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:02:50,556::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:02:50,556::task::990::TaskManager.Task::(_decref) Task=`a7fbd8d2-0ac8-4156-81f4-5b50f614ad2d`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:02:50,563::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4ed70837] >Thread-236::DEBUG::2014-03-30 11:02:50,564::task::595::TaskManager.Task::(_updateState) Task=`7ad5f4d5-3680-4e43-b812-8468347db109`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:02:50,564::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:02:50,564::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`366142fe-45e9-4d54-9761-752a01a91b1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:02:50,565::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:02:50,565::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:02:50,565::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`366142fe-45e9-4d54-9761-752a01a91b1a`::Granted request >Thread-236::DEBUG::2014-03-30 11:02:50,566::task::827::TaskManager.Task::(resourceAcquired) Task=`7ad5f4d5-3680-4e43-b812-8468347db109`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:02:50,566::task::990::TaskManager.Task::(_decref) Task=`7ad5f4d5-3680-4e43-b812-8468347db109`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:02:50,567::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:50,567::task::1185::TaskManager.Task::(prepare) Task=`7ad5f4d5-3680-4e43-b812-8468347db109`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:02:50,567::task::595::TaskManager.Task::(_updateState) Task=`7ad5f4d5-3680-4e43-b812-8468347db109`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:02:50,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:02:50,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:02:50,568::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:02:50,568::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:02:50,569::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:02:50,569::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:02:50,569::task::990::TaskManager.Task::(_decref) Task=`7ad5f4d5-3680-4e43-b812-8468347db109`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:02:51,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:02:51,622::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00545312 s, 751 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:52,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:52,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0469908 s, 21.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:52,964::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:02:53,512::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:02:53,524::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000384901 s, 899 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:54,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:54,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400531 s, 25.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:55,979::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:02:56,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:56,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474174 s, 21.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:02:58,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:02:58,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387341 s, 26.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:02:58,995::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:03:00,598::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-28::DEBUG::2014-03-30 11:03:00,599::task::595::TaskManager.Task::(_updateState) Task=`9b3051d3-c3c0-4ff0-9beb-1c75dff9601c`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:00,599::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:03:00,627::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:00,628::task::1185::TaskManager.Task::(prepare) Task=`9b3051d3-c3c0-4ff0-9beb-1c75dff9601c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:00,628::task::595::TaskManager.Task::(_updateState) Task=`9b3051d3-c3c0-4ff0-9beb-1c75dff9601c`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:00,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:00,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:00,628::task::990::TaskManager.Task::(_decref) Task=`9b3051d3-c3c0-4ff0-9beb-1c75dff9601c`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:03:00,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-236::DEBUG::2014-03-30 11:03:00,634::task::595::TaskManager.Task::(_updateState) Task=`47614b89-92dd-4a92-be3a-196ba49fd3c9`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:03:00,635::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:03:00,635::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`57f2dd5b-80b8-495e-b81e-07941be664c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:03:00,635::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:03:00,636::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:03:00,636::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`57f2dd5b-80b8-495e-b81e-07941be664c3`::Granted request >Thread-236::DEBUG::2014-03-30 11:03:00,636::task::827::TaskManager.Task::(resourceAcquired) Task=`47614b89-92dd-4a92-be3a-196ba49fd3c9`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:03:00,637::task::990::TaskManager.Task::(_decref) Task=`47614b89-92dd-4a92-be3a-196ba49fd3c9`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:03:00,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:00,638::task::1185::TaskManager.Task::(prepare) Task=`47614b89-92dd-4a92-be3a-196ba49fd3c9`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:00,638::task::595::TaskManager.Task::(_updateState) Task=`47614b89-92dd-4a92-be3a-196ba49fd3c9`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:03:00,638::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:03:00,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:03:00,639::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:03:00,639::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:03:00,639::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:03:00,639::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:03:00,640::task::990::TaskManager.Task::(_decref) Task=`47614b89-92dd-4a92-be3a-196ba49fd3c9`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:03:00,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:00,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0495642 s, 20.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:01,021::task::595::TaskManager.Task::(_updateState) Task=`d0c12dff-6dfd-4e9d-9cfe-81a05c9e71f1`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:01,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:03:01,022::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545312', 'lastCheck': '9.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384901', 'lastCheck': '7.5', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:01,022::task::1185::TaskManager.Task::(prepare) Task=`d0c12dff-6dfd-4e9d-9cfe-81a05c9e71f1`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545312', 'lastCheck': '9.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000384901', 'lastCheck': '7.5', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:01,022::task::595::TaskManager.Task::(_updateState) Task=`d0c12dff-6dfd-4e9d-9cfe-81a05c9e71f1`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:01,022::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:01,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:01,023::task::990::TaskManager.Task::(_decref) Task=`d0c12dff-6dfd-4e9d-9cfe-81a05c9e71f1`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:03:01,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:01,648::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00564856 s, 725 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:02,013::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:02,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:02,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0440519 s, 23.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:03:03,535::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:03:03,546::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000471629 s, 734 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:04,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:05,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567245 s, 18.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:05,029::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:07,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:07,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477851 s, 21.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:08,048::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:09,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:09,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410293 s, 25.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:10,672::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [431e32ae] >Thread-28::DEBUG::2014-03-30 11:03:10,673::task::595::TaskManager.Task::(_updateState) Task=`77badfc7-06ab-4492-aa8f-a44ac81757c7`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:10,673::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:03:10,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:10,707::task::1185::TaskManager.Task::(prepare) Task=`77badfc7-06ab-4492-aa8f-a44ac81757c7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:10,707::task::595::TaskManager.Task::(_updateState) Task=`77badfc7-06ab-4492-aa8f-a44ac81757c7`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:10,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:10,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:10,707::task::990::TaskManager.Task::(_decref) Task=`77badfc7-06ab-4492-aa8f-a44ac81757c7`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:03:10,713::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [431e32ae] >Thread-236::DEBUG::2014-03-30 11:03:10,713::task::595::TaskManager.Task::(_updateState) Task=`32dd2773-e667-45e8-8cb0-ca65ffa7a915`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:03:10,714::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:03:10,714::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`053c822b-3305-4610-9c93-6099e88a3544`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:03:10,714::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:03:10,715::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:03:10,715::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`053c822b-3305-4610-9c93-6099e88a3544`::Granted request >Thread-236::DEBUG::2014-03-30 11:03:10,715::task::827::TaskManager.Task::(resourceAcquired) Task=`32dd2773-e667-45e8-8cb0-ca65ffa7a915`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:03:10,716::task::990::TaskManager.Task::(_decref) Task=`32dd2773-e667-45e8-8cb0-ca65ffa7a915`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:03:10,717::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:10,717::task::1185::TaskManager.Task::(prepare) Task=`32dd2773-e667-45e8-8cb0-ca65ffa7a915`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:10,717::task::595::TaskManager.Task::(_updateState) Task=`32dd2773-e667-45e8-8cb0-ca65ffa7a915`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:03:10,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:03:10,718::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:03:10,718::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:03:10,718::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:03:10,718::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:03:10,719::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:03:10,719::task::990::TaskManager.Task::(_decref) Task=`32dd2773-e667-45e8-8cb0-ca65ffa7a915`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:03:11,063::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:11,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:11,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470869 s, 21.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:03:11,653::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:03:11,654::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:03:11,654::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::DEBUG::2014-03-30 11:03:11,654::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:03:11,657::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:11,673::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00535838 s, 382 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:03:11,673::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00535838 s, 382 kB/s'], size: 2048 >Thread-14::DEBUG::2014-03-30 11:03:11,673::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-03-30 11:03:11,673::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-03-30 11:03:11,674::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:03:11,674::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:03:11,674::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:03:11,675::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:03:11,675::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:03:11,675::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:03:11,676::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000567e404977a4e311|/dev/mapper/360060160f4a03000da2233488fa4e311|/dev/mapper/360060160f4a03000e86588568fa4e311|/dev/mapper/360060160f4a03000f8d72cd38ca4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:12,185::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:03:12,188::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:03:12,189::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=wxY9cX-001T-eqwx-zf7D-Yhcl-2Uwh-KUR3m6', 'LOCKPOLICY=', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:360060160f4a03000da2233488fa4e311,uuid:Qj89Z4-DLwY-sR5F-gGtn-bLRy-SNKX-2ho7ew,pestart:0,pecount:557,mapoffset:0', 'LEASERETRIES=3', 'SDUUID=dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'CLASS=Data', 'DESCRIPTION=Imp_Exp_DC0_data_domain0', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Imp_Exp_DC0', 'ROLE=Master', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', u'POOL_DOMAINS=dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=2', '_SHA_CKSUM=db97a5e6891143b5e26a4bf2aacf0ba3b85f20a6'] >Thread-14::INFO::2014-03-30 11:03:12,191::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_imageNS already registered >Thread-14::INFO::2014-03-30 11:03:12,191::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_volumeNS already registered >Thread-14::INFO::2014-03-30 11:03:12,191::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_lvmActivationNS already registered >Thread-14::DEBUG::2014-03-30 11:03:12,192::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000da2233488fa4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:12,358::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:03:12,362::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:12,376::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000892758 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:13,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:13,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562505 s, 18.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:03:13,557::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:03:13,569::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000369863 s, 935 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:14,077::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:15,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:15,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0653707 s, 15.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:16,210::task::595::TaskManager.Task::(_updateState) Task=`67156bfd-4c8c-4e87-bfee-cdf503b29681`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:16,210::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:03:16,211::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000892758', 'lastCheck': '3.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000369863', 'lastCheck': '2.6', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:16,211::task::1185::TaskManager.Task::(prepare) Task=`67156bfd-4c8c-4e87-bfee-cdf503b29681`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000892758', 'lastCheck': '3.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000369863', 'lastCheck': '2.6', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:16,211::task::595::TaskManager.Task::(_updateState) Task=`67156bfd-4c8c-4e87-bfee-cdf503b29681`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:16,211::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:16,211::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:16,212::task::990::TaskManager.Task::(_decref) Task=`67156bfd-4c8c-4e87-bfee-cdf503b29681`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:03:17,095::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:17,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:17,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513544 s, 19.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:19,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:19,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538588 s, 19.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:20,115::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:03:20,744::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:03:20,744::task::595::TaskManager.Task::(_updateState) Task=`7a2e9a4f-acc2-4e4d-984e-e2d8bc07c4c0`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:20,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:03:20,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:20,778::task::1185::TaskManager.Task::(prepare) Task=`7a2e9a4f-acc2-4e4d-984e-e2d8bc07c4c0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:20,778::task::595::TaskManager.Task::(_updateState) Task=`7a2e9a4f-acc2-4e4d-984e-e2d8bc07c4c0`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:20,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:20,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:20,779::task::990::TaskManager.Task::(_decref) Task=`7a2e9a4f-acc2-4e4d-984e-e2d8bc07c4c0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:03:20,784::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:03:20,784::task::595::TaskManager.Task::(_updateState) Task=`2eec5855-6eb3-4f3b-83fe-83ea0f037148`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:03:20,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:03:20,785::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`10f45866-296e-4772-a988-89bad9d028e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:03:20,785::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:03:20,785::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:03:20,786::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`10f45866-296e-4772-a988-89bad9d028e9`::Granted request >Thread-236::DEBUG::2014-03-30 11:03:20,786::task::827::TaskManager.Task::(resourceAcquired) Task=`2eec5855-6eb3-4f3b-83fe-83ea0f037148`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:03:20,786::task::990::TaskManager.Task::(_decref) Task=`2eec5855-6eb3-4f3b-83fe-83ea0f037148`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:03:20,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:20,788::task::1185::TaskManager.Task::(prepare) Task=`2eec5855-6eb3-4f3b-83fe-83ea0f037148`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985884094464', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:20,788::task::595::TaskManager.Task::(_updateState) Task=`2eec5855-6eb3-4f3b-83fe-83ea0f037148`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:03:20,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:03:20,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:03:20,789::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:03:20,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:03:20,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:03:20,789::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:03:20,789::task::990::TaskManager.Task::(_decref) Task=`2eec5855-6eb3-4f3b-83fe-83ea0f037148`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:03:21,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:22,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473212 s, 21.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:03:22,386::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:22,404::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00525931 s, 779 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:23,131::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:03:23,580::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:03:23,591::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000382378 s, 905 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:24,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:24,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391623 s, 26.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:26,150::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:26,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:26,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046971 s, 21.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:28,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:28,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048979 s, 20.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:29,168::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:30,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:30,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455494 s, 22.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:30,816::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:03:30,817::task::595::TaskManager.Task::(_updateState) Task=`d7a9ac4d-0dd9-4e41-867a-b91eb40b0a54`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:30,817::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:03:30,842::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:30,843::task::1185::TaskManager.Task::(prepare) Task=`d7a9ac4d-0dd9-4e41-867a-b91eb40b0a54`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:30,843::task::595::TaskManager.Task::(_updateState) Task=`d7a9ac4d-0dd9-4e41-867a-b91eb40b0a54`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:30,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:30,843::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:30,843::task::990::TaskManager.Task::(_decref) Task=`d7a9ac4d-0dd9-4e41-867a-b91eb40b0a54`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:03:30,848::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:03:30,849::task::595::TaskManager.Task::(_updateState) Task=`8e151559-7078-4e2a-bafb-818a8704fd6a`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:03:30,849::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:03:30,850::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`230bdcc8-4601-4edb-916d-b778a9d7647e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:03:30,850::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:03:30,850::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:03:30,851::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`230bdcc8-4601-4edb-916d-b778a9d7647e`::Granted request >Thread-236::DEBUG::2014-03-30 11:03:30,851::task::827::TaskManager.Task::(resourceAcquired) Task=`8e151559-7078-4e2a-bafb-818a8704fd6a`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:03:30,851::task::990::TaskManager.Task::(_decref) Task=`8e151559-7078-4e2a-bafb-818a8704fd6a`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:03:30,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985908867072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:30,853::task::1185::TaskManager.Task::(prepare) Task=`8e151559-7078-4e2a-bafb-818a8704fd6a`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1985908867072', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:30,853::task::595::TaskManager.Task::(_updateState) Task=`8e151559-7078-4e2a-bafb-818a8704fd6a`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:03:30,853::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:03:30,853::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:03:30,854::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:03:30,854::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:03:30,854::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:03:30,854::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:03:30,854::task::990::TaskManager.Task::(_decref) Task=`8e151559-7078-4e2a-bafb-818a8704fd6a`::ref 0 aborting False >Thread-28::DEBUG::2014-03-30 11:03:31,380::task::595::TaskManager.Task::(_updateState) Task=`079e0acb-a7cd-44bf-a27d-f35fc4c09edc`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:31,380::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:03:31,381::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00525931', 'lastCheck': '9.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000382378', 'lastCheck': '7.8', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:31,381::task::1185::TaskManager.Task::(prepare) Task=`079e0acb-a7cd-44bf-a27d-f35fc4c09edc`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00525931', 'lastCheck': '9.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000382378', 'lastCheck': '7.8', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:31,381::task::595::TaskManager.Task::(_updateState) Task=`079e0acb-a7cd-44bf-a27d-f35fc4c09edc`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:31,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:31,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:31,382::task::990::TaskManager.Task::(_decref) Task=`079e0acb-a7cd-44bf-a27d-f35fc4c09edc`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:03:32,181::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:03:32,413::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:32,435::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00902562 s, 454 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:32,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:32,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538644 s, 19.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:03:33,600::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:03:33,612::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000404171 s, 856 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:34,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:34,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0673427 s, 15.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:35,197::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:36,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:36,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0570629 s, 17.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:38,085::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call setupNetworks with ({'sw1': {'remove': 'true'}, 'sw2': {'remove': 'true'}}, {'bond0': {'remove': 'true'}}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:38,088::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:38,088::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:03:38,218::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:03:38,598::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:38,598::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-36::DEBUG::2014-03-30 11:03:38,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:39,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419362 s, 24.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:03:39,109::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:39,112::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:03:39,622::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:39,623::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:03:40,129::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:40,130::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:03:40,636::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:40,637::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:03:40,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:03:40,885::task::595::TaskManager.Task::(_updateState) Task=`0aed585f-1de7-402c-94a9-5b67a0f45ffa`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:03:40,885::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:03:40,937::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:03:40,938::task::1185::TaskManager.Task::(prepare) Task=`0aed585f-1de7-402c-94a9-5b67a0f45ffa`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:03:40,938::task::595::TaskManager.Task::(_updateState) Task=`0aed585f-1de7-402c-94a9-5b67a0f45ffa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:03:40,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:03:40,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:03:40,938::task::990::TaskManager.Task::(_decref) Task=`0aed585f-1de7-402c-94a9-5b67a0f45ffa`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:03:40,945::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:03:40,946::task::595::TaskManager.Task::(_updateState) Task=`98ac2059-f7f0-4135-b8eb-555de9eb0d9b`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:03:40,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:03:40,946::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`a9cdcc3b-a456-4200-a7a2-bb78438680fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:03:40,947::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:03:40,947::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:03:40,947::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`a9cdcc3b-a456-4200-a7a2-bb78438680fd`::Granted request >Thread-236::DEBUG::2014-03-30 11:03:40,948::task::827::TaskManager.Task::(resourceAcquired) Task=`98ac2059-f7f0-4135-b8eb-555de9eb0d9b`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:03:40,948::task::990::TaskManager.Task::(_decref) Task=`98ac2059-f7f0-4135-b8eb-555de9eb0d9b`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:03:40,949::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:40,949::task::1185::TaskManager.Task::(prepare) Task=`98ac2059-f7f0-4135-b8eb-555de9eb0d9b`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:40,949::task::595::TaskManager.Task::(_updateState) Task=`98ac2059-f7f0-4135-b8eb-555de9eb0d9b`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:03:40,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:03:40,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:03:40,950::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:03:40,950::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:03:40,950::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:03:40,951::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:03:40,951::task::990::TaskManager.Task::(_decref) Task=`98ac2059-f7f0-4135-b8eb-555de9eb0d9b`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:03:41,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:03:41,154::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:41,157::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:03:41,247::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:41,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0615141 s, 16.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:03:41,668::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:41,668::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:03:42,175::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:42,176::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-03-30 11:03:42,443::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:42,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00559294 s, 732 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:03:42,683::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [74c508c7] >Thread-13::DEBUG::2014-03-30 11:03:42,683::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:03:42,755::BindingXMLRPC::1074::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:03:43,188::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call getCapabilities with () {} flowID [74c508c7] >Thread-28::DEBUG::2014-03-30 11:03:43,189::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-28::DEBUG::2014-03-30 11:03:43,202::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:43,231::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.11.2.el6.x86_64', 'buildtime': 1393846365.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '0.2.beta2.el6ev', 'buildtime': 1395821236L, 'version': '4.14.5'}, 'qemu-kvm': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.5', 'buildtime': 1393584604L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5410 @ 2.33GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'gateway': '10.35.128.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'sw1': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': ['bond0']}, 'rhevm': {'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'ports': ['eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '44454C4C-3800-1034-8037-C8C04F4A334A', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4d', 'cfg': {'DEVICE': 'eth3', 'HWADDR': '00:15:17:a7:6a:4d', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'DEVICE': 'eth2', 'HWADDR': '00:15:17:a7:6a:4c', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:50', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:1d:09:68:71:50', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:7150/64'], 'speed': 1000, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:4e', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '00:1d:09:68:71:4e', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.2', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,lahf_lm,dts,tpr_shadow,vnmi,flexpriority,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7865', 'cpuSpeed': '2327.560', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.28'}} >Dummy-36::DEBUG::2014-03-30 11:03:43,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:43,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470917 s, 21.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:03:43,623::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:03:43,635::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000433556 s, 798 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:44,262::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:45,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:45,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389076 s, 26.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:03:46,536::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid eth1 interval: 8.13918304443 thisRx 4294920003 thisTx 4294967182 samples [(1396166616.727843, 47293, 310), (1396166618.8474159, 47421, 310), (1396166620.8546619, 0, 0), (1396166622.8609829, 0, 0), (1396166624.8670261, 0, 196)] >Thread-28::DEBUG::2014-03-30 11:03:46,537::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid bond0 interval: 8.13918304443 thisRx 4086317594 thisTx 4294938726 samples [(1396166616.727843, 208649702, 28570), (1396166618.8474159, 0, 0), (1396166620.8546619, 0, 0), (1396166622.8609829, 0, 0), (1396166624.8670261, 0, 0)] >Thread-28::DEBUG::2014-03-30 11:03:46,537::sampling::515::root::(_getInterfacesStats) {'network': {'bond4': {'txErrors': '0', 'state': 'down', 'name': 'bond4', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond0': {'txErrors': '0', 'state': 'down', 'name': 'bond0', 'txDropped': '0', 'txRate': '100.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '100.0', 'rxDropped': '0'}, 'bond1': {'txErrors': '0', 'state': 'down', 'name': 'bond1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond2': {'txErrors': '0', 'state': 'down', 'name': 'bond2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'bond3': {'txErrors': '0', 'state': 'down', 'name': 'bond3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'lo': {'txErrors': '0', 'state': 'up', 'name': 'lo', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'name': ';vdsmdummy;', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'rhevm': {'txErrors': '0', 'state': 'up', 'name': 'rhevm', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.6', 'rxDropped': '0'}, 'sw1': {'txErrors': '0', 'state': 'down', 'name': 'sw1', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth3': {'txErrors': '0', 'state': 'up', 'name': 'eth3', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth2': {'txErrors': '0', 'state': 'up', 'name': 'eth2', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.0', 'rxDropped': '0'}, 'eth1': {'txErrors': '0', 'state': 'up', 'name': 'eth1', 'txDropped': '0', 'txRate': '100.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '100.0', 'rxDropped': '0'}, 'eth0': {'txErrors': '0', 'state': 'up', 'name': 'eth0', 'txDropped': '0', 'txRate': '0.0', 'rxErrors': '0', 'speed': '1000', 'rxRate': '0.6', 'rxDropped': '0'}}, 'cpuUser': 0.0, 'txRate': 100.0, 'statsAge': 1.6692988872528076, 'cpuIdle': 100.0, 'cpuSys': 0.0, 'rxRate': 100.0} >Thread-28::DEBUG::2014-03-30 11:03:46,538::task::595::TaskManager.Task::(_updateState) Task=`caefa52b-b6c2-48f8-88c7-ff565c2ff667`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:46,538::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:03:46,538::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00559294', 'lastCheck': '4.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433556', 'lastCheck': '2.9', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:46,539::task::1185::TaskManager.Task::(prepare) Task=`caefa52b-b6c2-48f8-88c7-ff565c2ff667`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00559294', 'lastCheck': '4.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433556', 'lastCheck': '2.9', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:03:46,539::task::595::TaskManager.Task::(_updateState) Task=`caefa52b-b6c2-48f8-88c7-ff565c2ff667`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:46,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:46,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:46,539::task::990::TaskManager.Task::(_decref) Task=`caefa52b-b6c2-48f8-88c7-ff565c2ff667`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:03:47,277::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:47,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:47,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047095 s, 21.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:49,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:49,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394618 s, 25.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:50,294::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:03:50,983::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:03:50,984::task::595::TaskManager.Task::(_updateState) Task=`3a945c49-6d45-4c97-9c0c-9413bdb8375f`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:03:50,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:03:51,010::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:51,010::task::1185::TaskManager.Task::(prepare) Task=`3a945c49-6d45-4c97-9c0c-9413bdb8375f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:03:51,010::task::595::TaskManager.Task::(_updateState) Task=`3a945c49-6d45-4c97-9c0c-9413bdb8375f`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:03:51,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:03:51,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:03:51,011::task::990::TaskManager.Task::(_decref) Task=`3a945c49-6d45-4c97-9c0c-9413bdb8375f`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:03:51,018::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:03:51,019::task::595::TaskManager.Task::(_updateState) Task=`1ccb7584-3906-4e7d-937b-16bf21fd43e4`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:03:51,019::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:03:51,020::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`50f695d5-a9cd-49a7-8f11-22f09d37f1db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:03:51,020::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:03:51,020::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:03:51,020::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`50f695d5-a9cd-49a7-8f11-22f09d37f1db`::Granted request >Thread-236::DEBUG::2014-03-30 11:03:51,021::task::827::TaskManager.Task::(resourceAcquired) Task=`1ccb7584-3906-4e7d-937b-16bf21fd43e4`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:03:51,021::task::990::TaskManager.Task::(_decref) Task=`1ccb7584-3906-4e7d-937b-16bf21fd43e4`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:03:51,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:51,022::task::1185::TaskManager.Task::(prepare) Task=`1ccb7584-3906-4e7d-937b-16bf21fd43e4`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:03:51,022::task::595::TaskManager.Task::(_updateState) Task=`1ccb7584-3906-4e7d-937b-16bf21fd43e4`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:03:51,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:03:51,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:03:51,023::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:03:51,023::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:03:51,024::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:03:51,024::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:03:51,024::task::990::TaskManager.Task::(_decref) Task=`1ccb7584-3906-4e7d-937b-16bf21fd43e4`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:03:51,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:51,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477199 s, 21.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:03:52,470::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:03:52,492::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00949994 s, 431 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:53,311::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:03:53,647::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:03:53,659::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000369193 s, 937 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:53,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:53,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392646 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:03:55,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:56,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470987 s, 21.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:56,328::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:03:58,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:03:58,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735495 s, 13.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:03:59,345::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:00,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:00,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390641 s, 26.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:04:01,053::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:04:01,054::task::595::TaskManager.Task::(_updateState) Task=`5a0d7f90-6cdc-4357-ad89-0a13deff6b53`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:04:01,054::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:04:01,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:04:01,111::task::1185::TaskManager.Task::(prepare) Task=`5a0d7f90-6cdc-4357-ad89-0a13deff6b53`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:04:01,112::task::595::TaskManager.Task::(_updateState) Task=`5a0d7f90-6cdc-4357-ad89-0a13deff6b53`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:04:01,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:04:01,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:04:01,112::task::990::TaskManager.Task::(_decref) Task=`5a0d7f90-6cdc-4357-ad89-0a13deff6b53`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:04:01,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:04:01,118::task::595::TaskManager.Task::(_updateState) Task=`dc1519c0-dd08-48b5-80c7-40f6c10664c6`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:04:01,118::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:04:01,120::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`51377dc4-ce33-4b54-84ec-2b993c029cf9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:04:01,120::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:04:01,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:04:01,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`51377dc4-ce33-4b54-84ec-2b993c029cf9`::Granted request >Thread-236::DEBUG::2014-03-30 11:04:01,121::task::827::TaskManager.Task::(resourceAcquired) Task=`dc1519c0-dd08-48b5-80c7-40f6c10664c6`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:04:01,121::task::990::TaskManager.Task::(_decref) Task=`dc1519c0-dd08-48b5-80c7-40f6c10664c6`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:04:01,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:04:01,122::task::1185::TaskManager.Task::(prepare) Task=`dc1519c0-dd08-48b5-80c7-40f6c10664c6`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:04:01,123::task::595::TaskManager.Task::(_updateState) Task=`dc1519c0-dd08-48b5-80c7-40f6c10664c6`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:04:01,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:04:01,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:04:01,123::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:04:01,124::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:04:01,124::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:04:01,124::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:04:01,124::task::990::TaskManager.Task::(_decref) Task=`dc1519c0-dd08-48b5-80c7-40f6c10664c6`::ref 0 aborting False >Thread-28::DEBUG::2014-03-30 11:04:01,705::task::595::TaskManager.Task::(_updateState) Task=`4881cd17-da99-4dbc-bdd8-313227c3c391`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:04:01,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:04:01,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00949994', 'lastCheck': '9.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000369193', 'lastCheck': '8.0', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:04:01,705::task::1185::TaskManager.Task::(prepare) Task=`4881cd17-da99-4dbc-bdd8-313227c3c391`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00949994', 'lastCheck': '9.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000369193', 'lastCheck': '8.0', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:04:01,706::task::595::TaskManager.Task::(_updateState) Task=`4881cd17-da99-4dbc-bdd8-313227c3c391`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:04:01,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:04:01,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:04:01,706::task::990::TaskManager.Task::(_decref) Task=`4881cd17-da99-4dbc-bdd8-313227c3c391`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:04:02,365::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:02,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:02,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0534038 s, 19.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:04:02,515::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:04:02,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00392392 s, 1.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:04:03,667::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:04:03,679::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00043991 s, 787 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:04:04,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:04,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0646293 s, 15.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:04:05,379::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:06,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:06,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474424 s, 21.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:04:08,395::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:08,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:08,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394172 s, 26.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:04:10,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:11,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0837335 s, 12.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:04:11,148::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:04:11,149::task::595::TaskManager.Task::(_updateState) Task=`7289a98d-4a95-4223-acda-7918e684e879`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:04:11,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:04:11,175::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:04:11,175::task::1185::TaskManager.Task::(prepare) Task=`7289a98d-4a95-4223-acda-7918e684e879`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:04:11,175::task::595::TaskManager.Task::(_updateState) Task=`7289a98d-4a95-4223-acda-7918e684e879`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:04:11,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:04:11,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:04:11,176::task::990::TaskManager.Task::(_decref) Task=`7289a98d-4a95-4223-acda-7918e684e879`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:04:11,180::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:04:11,181::task::595::TaskManager.Task::(_updateState) Task=`c94b4a77-bc10-4e92-8ed3-a16c68da9dc4`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:04:11,181::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:04:11,182::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`5b21f171-0d39-485e-8851-826a5e60cae7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:04:11,182::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:04:11,182::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:04:11,182::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`5b21f171-0d39-485e-8851-826a5e60cae7`::Granted request >Thread-236::DEBUG::2014-03-30 11:04:11,183::task::827::TaskManager.Task::(resourceAcquired) Task=`c94b4a77-bc10-4e92-8ed3-a16c68da9dc4`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:04:11,183::task::990::TaskManager.Task::(_decref) Task=`c94b4a77-bc10-4e92-8ed3-a16c68da9dc4`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:04:11,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:04:11,184::task::1185::TaskManager.Task::(prepare) Task=`c94b4a77-bc10-4e92-8ed3-a16c68da9dc4`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:04:11,185::task::595::TaskManager.Task::(_updateState) Task=`c94b4a77-bc10-4e92-8ed3-a16c68da9dc4`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:04:11,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:04:11,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:04:11,185::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:04:11,186::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:04:11,186::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:04:11,186::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:04:11,186::task::990::TaskManager.Task::(_decref) Task=`c94b4a77-bc10-4e92-8ed3-a16c68da9dc4`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:04:11,412::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:04:12,607::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:04:12,629::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00987703 s, 415 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:04:13,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:13,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499869 s, 20.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:04:13,689::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:04:13,702::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000449246 s, 770 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:04:14,428::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:15,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:15,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470716 s, 21.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:04:16,869::task::595::TaskManager.Task::(_updateState) Task=`1888cdfc-17b8-4d1a-b08b-f24201405099`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:04:16,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-28::INFO::2014-03-30 11:04:16,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00987703', 'lastCheck': '4.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449246', 'lastCheck': '3.2', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:04:16,870::task::1185::TaskManager.Task::(prepare) Task=`1888cdfc-17b8-4d1a-b08b-f24201405099`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00987703', 'lastCheck': '4.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449246', 'lastCheck': '3.2', 'valid': True}} >Thread-28::DEBUG::2014-03-30 11:04:16,870::task::595::TaskManager.Task::(_updateState) Task=`1888cdfc-17b8-4d1a-b08b-f24201405099`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:04:16,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:04:16,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:04:16,871::task::990::TaskManager.Task::(_decref) Task=`1888cdfc-17b8-4d1a-b08b-f24201405099`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:04:17,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:04:17,446::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:17,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519843 s, 19.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:04:19,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:19,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458494 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:04:20,462::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:04:21,214::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-28::DEBUG::2014-03-30 11:04:21,214::task::595::TaskManager.Task::(_updateState) Task=`d2fa6bad-d1c5-47ef-8d27-a3a9b97a3d66`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:04:21,215::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:04:21,243::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:04:21,244::task::1185::TaskManager.Task::(prepare) Task=`d2fa6bad-d1c5-47ef-8d27-a3a9b97a3d66`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:04:21,244::task::595::TaskManager.Task::(_updateState) Task=`d2fa6bad-d1c5-47ef-8d27-a3a9b97a3d66`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:04:21,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:04:21,244::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:04:21,244::task::990::TaskManager.Task::(_decref) Task=`d2fa6bad-d1c5-47ef-8d27-a3a9b97a3d66`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:04:21,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:04:21,250::task::595::TaskManager.Task::(_updateState) Task=`fe7053a4-d32e-49e3-bc26-6bea6bf16440`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:04:21,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:04:21,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`18a9997a-3695-4e05-86fe-3b86e060eb1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:04:21,251::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:04:21,251::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:04:21,251::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`18a9997a-3695-4e05-86fe-3b86e060eb1c`::Granted request >Thread-236::DEBUG::2014-03-30 11:04:21,252::task::827::TaskManager.Task::(resourceAcquired) Task=`fe7053a4-d32e-49e3-bc26-6bea6bf16440`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:04:21,252::task::990::TaskManager.Task::(_decref) Task=`fe7053a4-d32e-49e3-bc26-6bea6bf16440`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:04:21,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072364032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:04:21,253::task::1185::TaskManager.Task::(prepare) Task=`fe7053a4-d32e-49e3-bc26-6bea6bf16440`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072364032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:04:21,254::task::595::TaskManager.Task::(_updateState) Task=`fe7053a4-d32e-49e3-bc26-6bea6bf16440`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:04:21,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:04:21,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:04:21,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:04:21,255::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:04:21,255::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:04:21,255::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:04:21,255::task::990::TaskManager.Task::(_decref) Task=`fe7053a4-d32e-49e3-bc26-6bea6bf16440`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:04:21,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:21,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561286 s, 18.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:04:22,638::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:04:22,664::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0135963 s, 301 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:04:23,478::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:04:23,712::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:04:23,723::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000430292 s, 804 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:04:23,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:23,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475504 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:04:25,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:04:26,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564266 s, 18.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:04:26,500::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:04:28,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:04:32,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:05:09,625::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:05:12,285::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 39.5705 s, 0.1 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:12,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 44.2798 s, 23.1 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:12,641::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:14,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:14,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458401 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:15,653::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:16,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:16,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460384 s, 22.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:18,666::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:18,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:18,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374708 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:20,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:20,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377705 s, 27.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:21,679::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:05:22,338::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:05:22,353::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00314034 s, 1.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:05:22,830::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:05:22,831::task::595::TaskManager.Task::(_updateState) Task=`aa371272-9fdf-49e2-a22b-b648c9d871c0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:22,831::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:05:22,855::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:22,855::task::1185::TaskManager.Task::(prepare) Task=`aa371272-9fdf-49e2-a22b-b648c9d871c0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:22,855::task::595::TaskManager.Task::(_updateState) Task=`aa371272-9fdf-49e2-a22b-b648c9d871c0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:22,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:22,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:22,856::task::990::TaskManager.Task::(_decref) Task=`aa371272-9fdf-49e2-a22b-b648c9d871c0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:05:22,862::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:05:22,863::task::595::TaskManager.Task::(_updateState) Task=`31344be3-2a17-40ad-8b94-f4e9683c0a48`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:05:22,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:05:22,863::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ac26b77d-a21e-4c67-8828-5d1ddfa18c5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:05:22,864::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:05:22,864::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:05:22,864::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ac26b77d-a21e-4c67-8828-5d1ddfa18c5b`::Granted request >Thread-236::DEBUG::2014-03-30 11:05:22,865::task::827::TaskManager.Task::(resourceAcquired) Task=`31344be3-2a17-40ad-8b94-f4e9683c0a48`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:05:22,865::task::990::TaskManager.Task::(_decref) Task=`31344be3-2a17-40ad-8b94-f4e9683c0a48`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:05:22,866::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072364032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:22,866::task::1185::TaskManager.Task::(prepare) Task=`31344be3-2a17-40ad-8b94-f4e9683c0a48`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072364032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:22,866::task::595::TaskManager.Task::(_updateState) Task=`31344be3-2a17-40ad-8b94-f4e9683c0a48`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:05:22,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:05:22,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:05:22,867::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:05:22,867::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:05:22,868::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:05:22,868::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:05:22,868::task::990::TaskManager.Task::(_decref) Task=`31344be3-2a17-40ad-8b94-f4e9683c0a48`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:05:22,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:23,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455368 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:05:23,360::task::595::TaskManager.Task::(_updateState) Task=`bf970faa-c734-4797-b7fd-66966637566d`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:23,360::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:05:23,360::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00314034', 'lastCheck': '1.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430292', 'lastCheck': '59.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:05:23,361::task::1185::TaskManager.Task::(prepare) Task=`bf970faa-c734-4797-b7fd-66966637566d`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00314034', 'lastCheck': '1.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000430292', 'lastCheck': '59.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:05:23,361::task::595::TaskManager.Task::(_updateState) Task=`bf970faa-c734-4797-b7fd-66966637566d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:23,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:23,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:23,361::task::990::TaskManager.Task::(_decref) Task=`bf970faa-c734-4797-b7fd-66966637566d`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:05:24,692::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:05:24,991::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:05:25,003::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00037039 s, 934 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:25,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:25,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452451 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:27,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:27,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380495 s, 26.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:27,704::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:29,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:29,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0801004 s, 12.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:30,716::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:31,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:31,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447424 s, 22.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:05:32,362::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:05:32,384::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00964322 s, 425 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:05:32,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:05:32,895::task::595::TaskManager.Task::(_updateState) Task=`5fb45c6d-e173-47ac-9042-965e407f77ad`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:32,896::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:05:32,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:32,918::task::1185::TaskManager.Task::(prepare) Task=`5fb45c6d-e173-47ac-9042-965e407f77ad`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:32,918::task::595::TaskManager.Task::(_updateState) Task=`5fb45c6d-e173-47ac-9042-965e407f77ad`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:32,918::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:32,918::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:32,918::task::990::TaskManager.Task::(_decref) Task=`5fb45c6d-e173-47ac-9042-965e407f77ad`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:05:32,924::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:05:32,925::task::595::TaskManager.Task::(_updateState) Task=`9626d1d6-594d-4d1b-b71d-6564ec9d992c`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:05:32,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:05:32,925::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e13efd72-3e35-4398-a5cb-a20edae9490b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:05:32,926::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:05:32,926::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:05:32,926::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e13efd72-3e35-4398-a5cb-a20edae9490b`::Granted request >Thread-236::DEBUG::2014-03-30 11:05:32,926::task::827::TaskManager.Task::(resourceAcquired) Task=`9626d1d6-594d-4d1b-b71d-6564ec9d992c`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:05:32,927::task::990::TaskManager.Task::(_decref) Task=`9626d1d6-594d-4d1b-b71d-6564ec9d992c`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:05:32,927::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072200192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:32,928::task::1185::TaskManager.Task::(prepare) Task=`9626d1d6-594d-4d1b-b71d-6564ec9d992c`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072200192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:32,928::task::595::TaskManager.Task::(_updateState) Task=`9626d1d6-594d-4d1b-b71d-6564ec9d992c`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:05:32,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:05:32,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:05:32,928::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:05:32,929::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:05:32,929::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:05:32,929::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:05:32,929::task::990::TaskManager.Task::(_decref) Task=`9626d1d6-594d-4d1b-b71d-6564ec9d992c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:05:33,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:05:33,729::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:33,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375309 s, 27.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:05:35,014::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:05:35,025::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000454459 s, 761 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:35,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:35,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372183 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:36,741::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:37,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:37,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451847 s, 22.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:05:38,743::task::595::TaskManager.Task::(_updateState) Task=`68ec4ebe-7f16-4c58-9c51-556091779693`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:38,743::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:05:38,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00964322', 'lastCheck': '6.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454459', 'lastCheck': '3.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:05:38,744::task::1185::TaskManager.Task::(prepare) Task=`68ec4ebe-7f16-4c58-9c51-556091779693`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00964322', 'lastCheck': '6.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000454459', 'lastCheck': '3.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:05:38,744::task::595::TaskManager.Task::(_updateState) Task=`68ec4ebe-7f16-4c58-9c51-556091779693`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:38,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:38,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:38,745::task::990::TaskManager.Task::(_decref) Task=`68ec4ebe-7f16-4c58-9c51-556091779693`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:05:39,752::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:40,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:40,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369134 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:42,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:42,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371013 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:05:42,392::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:05:42,415::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00968988 s, 423 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:42,763::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:05:42,954::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:05:42,955::task::595::TaskManager.Task::(_updateState) Task=`e77f593a-695d-4955-810f-aadfffa64d76`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:42,955::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:05:42,976::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:42,976::task::1185::TaskManager.Task::(prepare) Task=`e77f593a-695d-4955-810f-aadfffa64d76`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:42,977::task::595::TaskManager.Task::(_updateState) Task=`e77f593a-695d-4955-810f-aadfffa64d76`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:42,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:42,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:42,977::task::990::TaskManager.Task::(_decref) Task=`e77f593a-695d-4955-810f-aadfffa64d76`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:05:42,982::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:05:42,983::task::595::TaskManager.Task::(_updateState) Task=`5caa37e7-d741-4ac6-8ee0-983342d77344`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:05:42,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:05:42,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`f9b5397c-444a-42ea-8f4c-802fc761e8a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:05:42,984::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:05:42,984::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:05:42,984::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`f9b5397c-444a-42ea-8f4c-802fc761e8a0`::Granted request >Thread-236::DEBUG::2014-03-30 11:05:42,985::task::827::TaskManager.Task::(resourceAcquired) Task=`5caa37e7-d741-4ac6-8ee0-983342d77344`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:05:42,985::task::990::TaskManager.Task::(_decref) Task=`5caa37e7-d741-4ac6-8ee0-983342d77344`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:05:42,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072200192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:42,986::task::1185::TaskManager.Task::(prepare) Task=`5caa37e7-d741-4ac6-8ee0-983342d77344`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072200192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:42,986::task::595::TaskManager.Task::(_updateState) Task=`5caa37e7-d741-4ac6-8ee0-983342d77344`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:05:42,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:05:42,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:05:42,987::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:05:42,987::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:05:42,987::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:05:42,988::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:05:42,988::task::990::TaskManager.Task::(_decref) Task=`5caa37e7-d741-4ac6-8ee0-983342d77344`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:05:44,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:44,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451411 s, 22.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:05:45,034::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:05:45,047::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000425319 s, 814 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:45,776::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:46,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:46,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456757 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:48,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:48,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037009 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:48,788::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:50,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:50,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449791 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:51,800::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:05:52,423::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:05:52,441::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00541214 s, 757 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:52,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:52,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448358 s, 22.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:05:53,011::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:05:53,012::task::595::TaskManager.Task::(_updateState) Task=`5b303a25-491e-4cef-927b-21ba7ae3df36`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:53,013::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:05:53,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:53,068::task::1185::TaskManager.Task::(prepare) Task=`5b303a25-491e-4cef-927b-21ba7ae3df36`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:05:53,069::task::595::TaskManager.Task::(_updateState) Task=`5b303a25-491e-4cef-927b-21ba7ae3df36`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:53,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:53,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:53,069::task::990::TaskManager.Task::(_decref) Task=`5b303a25-491e-4cef-927b-21ba7ae3df36`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:05:53,075::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:05:53,075::task::595::TaskManager.Task::(_updateState) Task=`4c364af9-7a92-4b68-80d4-4af94f138221`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:05:53,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:05:53,076::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6d28e9e9-e2d7-484b-8f41-a837c72a743b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:05:53,076::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:05:53,077::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:05:53,077::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6d28e9e9-e2d7-484b-8f41-a837c72a743b`::Granted request >Thread-236::DEBUG::2014-03-30 11:05:53,077::task::827::TaskManager.Task::(resourceAcquired) Task=`4c364af9-7a92-4b68-80d4-4af94f138221`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:05:53,078::task::990::TaskManager.Task::(_decref) Task=`4c364af9-7a92-4b68-80d4-4af94f138221`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:05:53,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992041824256', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:53,079::task::1185::TaskManager.Task::(prepare) Task=`4c364af9-7a92-4b68-80d4-4af94f138221`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992041824256', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:05:53,079::task::595::TaskManager.Task::(_updateState) Task=`4c364af9-7a92-4b68-80d4-4af94f138221`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:05:53,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:05:53,080::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:05:53,080::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:05:53,080::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:05:53,080::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:05:53,080::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:05:53,081::task::990::TaskManager.Task::(_decref) Task=`4c364af9-7a92-4b68-80d4-4af94f138221`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:05:53,928::task::595::TaskManager.Task::(_updateState) Task=`0f06d9ab-f51b-4f75-bd6a-e53b55bf80be`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:05:53,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:05:53,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541214', 'lastCheck': '1.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425319', 'lastCheck': '8.9', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:05:53,929::task::1185::TaskManager.Task::(prepare) Task=`0f06d9ab-f51b-4f75-bd6a-e53b55bf80be`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541214', 'lastCheck': '1.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425319', 'lastCheck': '8.9', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:05:53,929::task::595::TaskManager.Task::(_updateState) Task=`0f06d9ab-f51b-4f75-bd6a-e53b55bf80be`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:05:53,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:05:53,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:05:53,930::task::990::TaskManager.Task::(_decref) Task=`0f06d9ab-f51b-4f75-bd6a-e53b55bf80be`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:05:54,812::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:54,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:54,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037044 s, 27.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:05:55,049::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114 >Thread-15::DEBUG::2014-03-30 11:05:55,055::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114 >Thread-15::DEBUG::2014-03-30 11:05:55,057::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-15::DEBUG::2014-03-30 11:05:55,065::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=Export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', 'REMOTE_PATH=10.35.160.108:/RHEV/kuk', 'ROLE=Regular', 'SDUUID=3ffbee88-0d84-4a95-bba0-e8c2b2cfc114', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=395010f55dbb653af315d0ae088b6cc18568bd44'] >Thread-15::DEBUG::2014-03-30 11:05:55,068::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-15::INFO::2014-03-30 11:05:55,068::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114_imageNS already registered >Thread-15::INFO::2014-03-30 11:05:55,068::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114_volumeNS already registered >Thread-15::DEBUG::2014-03-30 11:05:55,077::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:05:55,090::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000902289 s, 383 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:05:56,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:57,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037015 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:05:57,823::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:05:59,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:05:59,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449979 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:00,835::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:01,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:01,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371641 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:06:02,450::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:06:02,468::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00479109 s, 855 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:03,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:06:03,103::task::595::TaskManager.Task::(_updateState) Task=`0b51f00b-bd23-4148-a2c6-bf8b9c152ff7`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:03,104::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:06:03,135::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:03,135::task::1185::TaskManager.Task::(prepare) Task=`0b51f00b-bd23-4148-a2c6-bf8b9c152ff7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:03,135::task::595::TaskManager.Task::(_updateState) Task=`0b51f00b-bd23-4148-a2c6-bf8b9c152ff7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:03,136::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:03,136::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:03,136::task::990::TaskManager.Task::(_decref) Task=`0b51f00b-bd23-4148-a2c6-bf8b9c152ff7`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:06:03,142::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:06:03,142::task::595::TaskManager.Task::(_updateState) Task=`6f1947bf-d2e8-48ad-9a8f-21e2bb0bf397`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:06:03,142::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:06:03,143::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`978cb884-79d4-4b5e-a067-1697dfb847d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:06:03,143::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:06:03,143::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:06:03,143::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`978cb884-79d4-4b5e-a067-1697dfb847d3`::Granted request >Thread-236::DEBUG::2014-03-30 11:06:03,144::task::827::TaskManager.Task::(resourceAcquired) Task=`6f1947bf-d2e8-48ad-9a8f-21e2bb0bf397`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:06:03,144::task::990::TaskManager.Task::(_decref) Task=`6f1947bf-d2e8-48ad-9a8f-21e2bb0bf397`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:06:03,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991751991296', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:03,145::task::1185::TaskManager.Task::(prepare) Task=`6f1947bf-d2e8-48ad-9a8f-21e2bb0bf397`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991751991296', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:03,145::task::595::TaskManager.Task::(_updateState) Task=`6f1947bf-d2e8-48ad-9a8f-21e2bb0bf397`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:06:03,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:06:03,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:06:03,146::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:06:03,146::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:06:03,146::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:06:03,146::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:06:03,146::task::990::TaskManager.Task::(_decref) Task=`6f1947bf-d2e8-48ad-9a8f-21e2bb0bf397`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:03,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:03,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374126 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:03,847::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:06:05,101::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:06:05,113::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00045779 s, 756 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:06:05,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:05,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045576 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:06,860::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:07,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:07,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513817 s, 19.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:09,100::task::595::TaskManager.Task::(_updateState) Task=`8068f05d-fe9f-4354-9663-f3c2c3d5b8d1`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:09,100::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:06:09,100::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00479109', 'lastCheck': '6.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045779', 'lastCheck': '4.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:09,100::task::1185::TaskManager.Task::(prepare) Task=`8068f05d-fe9f-4354-9663-f3c2c3d5b8d1`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00479109', 'lastCheck': '6.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045779', 'lastCheck': '4.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:09,101::task::595::TaskManager.Task::(_updateState) Task=`8068f05d-fe9f-4354-9663-f3c2c3d5b8d1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:09,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:09,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:09,101::task::990::TaskManager.Task::(_decref) Task=`8068f05d-fe9f-4354-9663-f3c2c3d5b8d1`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:09,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:09,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370411 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:09,874::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:11,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:11,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369978 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:06:12,477::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:06:12,499::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00900675 s, 455 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:12,886::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:06:13,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [29ff67d6] >Thread-13::DEBUG::2014-03-30 11:06:13,173::task::595::TaskManager.Task::(_updateState) Task=`3a64b22a-d398-48e6-b120-3b2adbb87e12`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:13,173::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:06:13,202::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:13,202::task::1185::TaskManager.Task::(prepare) Task=`3a64b22a-d398-48e6-b120-3b2adbb87e12`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:13,202::task::595::TaskManager.Task::(_updateState) Task=`3a64b22a-d398-48e6-b120-3b2adbb87e12`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:13,203::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:13,203::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:13,203::task::990::TaskManager.Task::(_decref) Task=`3a64b22a-d398-48e6-b120-3b2adbb87e12`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:06:13,209::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [29ff67d6] >Thread-236::DEBUG::2014-03-30 11:06:13,209::task::595::TaskManager.Task::(_updateState) Task=`d0dfd17c-f373-40a2-b29b-e0076f95032a`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:06:13,210::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:06:13,210::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9536ec1a-312c-45ed-b471-27bec25b4c3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:06:13,210::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:06:13,211::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:06:13,211::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9536ec1a-312c-45ed-b471-27bec25b4c3a`::Granted request >Thread-236::DEBUG::2014-03-30 11:06:13,212::task::827::TaskManager.Task::(resourceAcquired) Task=`d0dfd17c-f373-40a2-b29b-e0076f95032a`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:06:13,212::task::990::TaskManager.Task::(_decref) Task=`d0dfd17c-f373-40a2-b29b-e0076f95032a`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:06:13,213::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991604174848', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:13,213::task::1185::TaskManager.Task::(prepare) Task=`d0dfd17c-f373-40a2-b29b-e0076f95032a`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991604174848', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:13,213::task::595::TaskManager.Task::(_updateState) Task=`d0dfd17c-f373-40a2-b29b-e0076f95032a`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:06:13,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:06:13,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:06:13,214::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:06:13,214::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:06:13,214::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:06:13,215::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:06:13,215::task::990::TaskManager.Task::(_decref) Task=`d0dfd17c-f373-40a2-b29b-e0076f95032a`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:13,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:14,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044939 s, 22.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:06:15,122::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:06:15,134::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000480719 s, 720 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:15,897::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:16,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:16,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452457 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:06:18,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:18,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370265 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:18,908::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:20,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:20,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452225 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:21,920::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:22,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:06:22,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:22,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456596 s, 22.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:06:22,605::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0084306 s, 486 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:23,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:06:23,250::task::595::TaskManager.Task::(_updateState) Task=`aad74cca-35be-4374-bf76-58ec9a9e7fff`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:23,250::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:06:23,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:23,275::task::1185::TaskManager.Task::(prepare) Task=`aad74cca-35be-4374-bf76-58ec9a9e7fff`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:23,275::task::595::TaskManager.Task::(_updateState) Task=`aad74cca-35be-4374-bf76-58ec9a9e7fff`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:23,275::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:23,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:23,276::task::990::TaskManager.Task::(_decref) Task=`aad74cca-35be-4374-bf76-58ec9a9e7fff`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:06:23,281::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:06:23,281::task::595::TaskManager.Task::(_updateState) Task=`33c8079f-c28f-4289-9a38-4330d3020f66`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:06:23,282::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:06:23,282::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`83a53e6d-77d7-47ef-b864-e7117de9e274`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:06:23,283::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:06:23,283::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:06:23,283::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`83a53e6d-77d7-47ef-b864-e7117de9e274`::Granted request >Thread-236::DEBUG::2014-03-30 11:06:23,284::task::827::TaskManager.Task::(resourceAcquired) Task=`33c8079f-c28f-4289-9a38-4330d3020f66`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:06:23,284::task::990::TaskManager.Task::(_decref) Task=`33c8079f-c28f-4289-9a38-4330d3020f66`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:06:23,285::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991441743872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:23,285::task::1185::TaskManager.Task::(prepare) Task=`33c8079f-c28f-4289-9a38-4330d3020f66`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991441743872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:23,285::task::595::TaskManager.Task::(_updateState) Task=`33c8079f-c28f-4289-9a38-4330d3020f66`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:06:23,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:06:23,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:06:23,286::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:06:23,286::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:06:23,286::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:06:23,287::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:06:23,287::task::990::TaskManager.Task::(_decref) Task=`33c8079f-c28f-4289-9a38-4330d3020f66`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:06:24,269::task::595::TaskManager.Task::(_updateState) Task=`14ff76b6-f0a9-4f7f-a212-b80f535b3c93`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:24,269::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:06:24,269::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0084306', 'lastCheck': '1.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480719', 'lastCheck': '9.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:24,269::task::1185::TaskManager.Task::(prepare) Task=`14ff76b6-f0a9-4f7f-a212-b80f535b3c93`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0084306', 'lastCheck': '1.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000480719', 'lastCheck': '9.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:24,270::task::595::TaskManager.Task::(_updateState) Task=`14ff76b6-f0a9-4f7f-a212-b80f535b3c93`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:24,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:24,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:24,270::task::990::TaskManager.Task::(_decref) Task=`14ff76b6-f0a9-4f7f-a212-b80f535b3c93`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:24,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:06:24,674::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-13::DEBUG::2014-03-30 11:06:24,675::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:06:24,684::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call setupNetworks with ({'sw1': {'bonding': 'bond0', 'bridged': 'false'}}, {'bond0': {'nics': ['eth3', 'eth2'], 'options': 'mode=4 miimon=100'}}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [29c86b0d] >Dummy-36::DEBUG::2014-03-30 11:06:24,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397257 s, 25.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:24,933::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:06:25,150::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:06:25,168::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000902273 s, 383 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:06:25,182::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:25,182::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:06:25,687::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:25,687::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:06:26,193::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:26,193::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:06:26,698::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:26,698::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-36::DEBUG::2014-03-30 11:06:26,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:26,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045085 s, 22.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:06:27,204::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:27,204::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:06:27,709::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:27,709::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:06:27,946::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:06:28,215::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:28,215::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:06:28,720::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:28,720::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-36::DEBUG::2014-03-30 11:06:28,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:28,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370283 s, 27.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:06:29,225::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [29c86b0d] >Thread-28::DEBUG::2014-03-30 11:06:29,226::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:06:29,671::BindingXMLRPC::1074::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:06:29,731::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call getCapabilities with () {} flowID [29c86b0d] >Thread-13::DEBUG::2014-03-30 11:06:29,732::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-03-30 11:06:29,746::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:29,778::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.11.2.el6.x86_64', 'buildtime': 1393846365.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '0.2.beta2.el6ev', 'buildtime': 1395821236L, 'version': '4.14.5'}, 'qemu-kvm': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.5', 'buildtime': 1393584604L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5410 @ 2.33GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'sw1': {'iface': u'bond0', 'addr': '', 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'bridged': False, 'interface': u'bond0', 'ipv6gateway': '::', 'gateway': ''}, 'rhevm': {'iface': 'rhevm', 'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'gateway': '10.35.128.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'ports': ['eth0']}}, 'uuid': '44454C4C-3800-1034-8037-C8C04F4A334A', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4d', 'MASTER': 'bond0', 'DEVICE': 'eth3', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4D', 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4C', 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:50', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:1d:09:68:71:50', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:7150/64'], 'speed': 1000, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:4e', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '00:1d:09:68:71:4e', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.2', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,lahf_lm,dts,tpr_shadow,vnmi,flexpriority,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth2', 'eth3'], 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'DEVICE': 'bond0', 'NM_CONTROLLED': 'no', 'DEFROUTE': 'no', 'ONBOOT': 'yes', 'BONDING_OPTS': 'mode=4 miimon=100'}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7865', 'cpuSpeed': '2327.560', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.28'}} >BindingXMLRPC::ERROR::2014-03-30 11:06:30,958::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:30,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:31,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369067 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:06:32,647::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:06:32,664::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00428453 s, 956 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:06:33,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:33,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371751 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:33,317::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:06:33,318::task::595::TaskManager.Task::(_updateState) Task=`556a0734-2dd7-4ce6-a572-b4ddd1f8ae1e`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:33,318::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:06:33,347::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:33,347::task::1185::TaskManager.Task::(prepare) Task=`556a0734-2dd7-4ce6-a572-b4ddd1f8ae1e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:33,348::task::595::TaskManager.Task::(_updateState) Task=`556a0734-2dd7-4ce6-a572-b4ddd1f8ae1e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:33,348::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:33,348::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:33,348::task::990::TaskManager.Task::(_decref) Task=`556a0734-2dd7-4ce6-a572-b4ddd1f8ae1e`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:06:33,357::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:06:33,357::task::595::TaskManager.Task::(_updateState) Task=`a77ddd1b-0158-4ba3-9c4d-ca346544450a`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:06:33,357::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:06:33,358::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`59e3679d-248f-4596-9b21-7e7f9e62dd00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:06:33,358::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:06:33,359::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:06:33,359::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`59e3679d-248f-4596-9b21-7e7f9e62dd00`::Granted request >Thread-236::DEBUG::2014-03-30 11:06:33,359::task::827::TaskManager.Task::(resourceAcquired) Task=`a77ddd1b-0158-4ba3-9c4d-ca346544450a`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:06:33,360::task::990::TaskManager.Task::(_decref) Task=`a77ddd1b-0158-4ba3-9c4d-ca346544450a`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:06:33,361::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991164100608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:33,361::task::1185::TaskManager.Task::(prepare) Task=`a77ddd1b-0158-4ba3-9c4d-ca346544450a`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1991164100608', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:33,361::task::595::TaskManager.Task::(_updateState) Task=`a77ddd1b-0158-4ba3-9c4d-ca346544450a`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:06:33,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:06:33,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:06:33,362::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:06:33,362::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:06:33,362::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:06:33,362::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:06:33,363::task::990::TaskManager.Task::(_decref) Task=`a77ddd1b-0158-4ba3-9c4d-ca346544450a`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:06:33,970::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:06:35,179::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:06:35,190::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00045618 s, 758 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:06:35,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:35,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461916 s, 22.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:36,983::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:37,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:37,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449393 s, 22.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:39,463::task::595::TaskManager.Task::(_updateState) Task=`fb2ccc5a-fcc7-40d4-90e0-fa39faf44bf8`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:39,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:06:39,463::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00428453', 'lastCheck': '6.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045618', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:39,464::task::1185::TaskManager.Task::(prepare) Task=`fb2ccc5a-fcc7-40d4-90e0-fa39faf44bf8`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00428453', 'lastCheck': '6.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00045618', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:39,464::task::595::TaskManager.Task::(_updateState) Task=`fb2ccc5a-fcc7-40d4-90e0-fa39faf44bf8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:39,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:39,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:39,464::task::990::TaskManager.Task::(_decref) Task=`fb2ccc5a-fcc7-40d4-90e0-fa39faf44bf8`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:39,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:39,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370094 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:39,996::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:41,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:41,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448298 s, 22.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:06:42,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:06:42,691::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00421757 s, 971 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:43,007::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:06:43,385::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:06:43,386::task::595::TaskManager.Task::(_updateState) Task=`e1f09c2e-19bf-469f-b2ec-ec75d9e9cd0c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:43,386::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:06:43,658::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:43,658::task::1185::TaskManager.Task::(prepare) Task=`e1f09c2e-19bf-469f-b2ec-ec75d9e9cd0c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:43,658::task::595::TaskManager.Task::(_updateState) Task=`e1f09c2e-19bf-469f-b2ec-ec75d9e9cd0c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:43,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:43,659::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:43,659::task::990::TaskManager.Task::(_decref) Task=`e1f09c2e-19bf-469f-b2ec-ec75d9e9cd0c`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:06:43,664::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:06:43,665::task::595::TaskManager.Task::(_updateState) Task=`878f37c9-37b1-4392-82ba-f773cf102fc1`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:06:43,665::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:06:43,666::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e28778f4-81a5-481d-94a8-071800f0791d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:06:43,666::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:06:43,667::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:06:43,667::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e28778f4-81a5-481d-94a8-071800f0791d`::Granted request >Thread-236::DEBUG::2014-03-30 11:06:43,667::task::827::TaskManager.Task::(resourceAcquired) Task=`878f37c9-37b1-4392-82ba-f773cf102fc1`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:06:43,667::task::990::TaskManager.Task::(_decref) Task=`878f37c9-37b1-4392-82ba-f773cf102fc1`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:06:43,669::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068104192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:43,669::task::1185::TaskManager.Task::(prepare) Task=`878f37c9-37b1-4392-82ba-f773cf102fc1`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068104192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:43,669::task::595::TaskManager.Task::(_updateState) Task=`878f37c9-37b1-4392-82ba-f773cf102fc1`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:06:43,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:06:43,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:06:43,670::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:06:43,670::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:06:43,670::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:06:43,670::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:06:43,671::task::990::TaskManager.Task::(_decref) Task=`878f37c9-37b1-4392-82ba-f773cf102fc1`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:43,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:43,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450253 s, 22.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:06:45,200::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:06:45,214::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000512768 s, 675 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:06:45,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:45,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459199 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:46,021::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:47,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:48,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371962 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:49,032::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:50,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:50,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450488 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:52,050::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:52,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:52,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453748 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:06:52,699::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:06:52,717::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00442357 s, 926 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:06:53,699::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [431e32ae] >Thread-13::DEBUG::2014-03-30 11:06:53,699::task::595::TaskManager.Task::(_updateState) Task=`881e4ff1-74ae-48de-bfe9-992251d0b5c9`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:53,700::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:06:53,727::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:53,727::task::1185::TaskManager.Task::(prepare) Task=`881e4ff1-74ae-48de-bfe9-992251d0b5c9`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:06:53,727::task::595::TaskManager.Task::(_updateState) Task=`881e4ff1-74ae-48de-bfe9-992251d0b5c9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:53,727::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:53,727::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:53,728::task::990::TaskManager.Task::(_decref) Task=`881e4ff1-74ae-48de-bfe9-992251d0b5c9`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:06:53,733::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [431e32ae] >Thread-236::DEBUG::2014-03-30 11:06:53,734::task::595::TaskManager.Task::(_updateState) Task=`6f76740b-2d99-4d65-862b-613aa8414d76`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:06:53,734::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:06:53,734::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9f204f24-2acf-46ff-a951-a599c07f47e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:06:53,735::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:06:53,735::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:06:53,735::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9f204f24-2acf-46ff-a951-a599c07f47e4`::Granted request >Thread-236::DEBUG::2014-03-30 11:06:53,736::task::827::TaskManager.Task::(resourceAcquired) Task=`6f76740b-2d99-4d65-862b-613aa8414d76`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:06:53,736::task::990::TaskManager.Task::(_decref) Task=`6f76740b-2d99-4d65-862b-613aa8414d76`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:06:53,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:53,737::task::1185::TaskManager.Task::(prepare) Task=`6f76740b-2d99-4d65-862b-613aa8414d76`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:06:53,737::task::595::TaskManager.Task::(_updateState) Task=`6f76740b-2d99-4d65-862b-613aa8414d76`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:06:53,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:06:53,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:06:53,738::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:06:53,738::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:06:53,739::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:06:53,739::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:06:53,739::task::990::TaskManager.Task::(_decref) Task=`6f76740b-2d99-4d65-862b-613aa8414d76`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:54,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:06:54,632::task::595::TaskManager.Task::(_updateState) Task=`01182f77-5b18-494f-ba63-ea53ad232c8e`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:06:54,633::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:06:54,633::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00442357', 'lastCheck': '1.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512768', 'lastCheck': '9.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:54,633::task::1185::TaskManager.Task::(prepare) Task=`01182f77-5b18-494f-ba63-ea53ad232c8e`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00442357', 'lastCheck': '1.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000512768', 'lastCheck': '9.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:06:54,633::task::595::TaskManager.Task::(_updateState) Task=`01182f77-5b18-494f-ba63-ea53ad232c8e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:06:54,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:06:54,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:06:54,634::task::990::TaskManager.Task::(_decref) Task=`01182f77-5b18-494f-ba63-ea53ad232c8e`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:06:54,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.335482 s, 3.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:55,062::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:06:55,226::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:06:55,238::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000440907 s, 785 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:06:56,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:56,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453733 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:06:58,073::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:06:58,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:06:58,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453027 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:00,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:01,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369084 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:01,085::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:07:01,720::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-13::DEBUG::2014-03-30 11:07:01,720::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call setupNetworks with ({'sw1': {'bonding': 'bond0', 'STP': 'no', 'bridged': 'true'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:01,721::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:02,229::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:02,229::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-03-30 11:07:02,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-03-30 11:07:02,744::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:02,747::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-03-30 11:07:02,757::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00374363 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:03,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:03,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374971 s, 27.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:07:03,265::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:03,265::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:03,767::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [28feaba] >Thread-28::DEBUG::2014-03-30 11:07:03,768::task::595::TaskManager.Task::(_updateState) Task=`cb4fb762-43ab-427f-8c3c-0323895fc944`::moving from state init -> state preparing >Thread-28::INFO::2014-03-30 11:07:03,768::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-28::INFO::2014-03-30 11:07:03,789::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:07:03,790::task::1185::TaskManager.Task::(prepare) Task=`cb4fb762-43ab-427f-8c3c-0323895fc944`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-28::DEBUG::2014-03-30 11:07:03,790::task::595::TaskManager.Task::(_updateState) Task=`cb4fb762-43ab-427f-8c3c-0323895fc944`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-03-30 11:07:03,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-03-30 11:07:03,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-03-30 11:07:03,790::task::990::TaskManager.Task::(_decref) Task=`cb4fb762-43ab-427f-8c3c-0323895fc944`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:07:03,844::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [28feaba] >Thread-236::DEBUG::2014-03-30 11:07:03,844::task::595::TaskManager.Task::(_updateState) Task=`c640a29e-5cb7-4393-afc0-18365ba42b20`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:07:03,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:07:03,845::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`fda7f962-e6d8-473e-b516-4a97d7f11714`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:07:03,845::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:07:03,846::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:07:03,846::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`fda7f962-e6d8-473e-b516-4a97d7f11714`::Granted request >Thread-236::DEBUG::2014-03-30 11:07:03,846::task::827::TaskManager.Task::(resourceAcquired) Task=`c640a29e-5cb7-4393-afc0-18365ba42b20`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:07:03,846::task::990::TaskManager.Task::(_decref) Task=`c640a29e-5cb7-4393-afc0-18365ba42b20`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:07:03,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:03,848::task::1185::TaskManager.Task::(prepare) Task=`c640a29e-5cb7-4393-afc0-18365ba42b20`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:03,848::task::595::TaskManager.Task::(_updateState) Task=`c640a29e-5cb7-4393-afc0-18365ba42b20`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:07:03,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:07:03,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:07:03,849::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:07:03,849::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:07:03,849::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:07:03,849::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:07:03,850::task::990::TaskManager.Task::(_decref) Task=`c640a29e-5cb7-4393-afc0-18365ba42b20`::ref 0 aborting False >Thread-28::DEBUG::2014-03-30 11:07:03,860::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:03,861::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:07:04,099::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:07:04,406::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:04,406::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:04,912::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:04,912::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-36::DEBUG::2014-03-30 11:07:05,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:05,302::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:05,337::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000434795 s, 796 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:05,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.140926 s, 7.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:07:05,421::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [27c082ae] >Thread-28::DEBUG::2014-03-30 11:07:05,424::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:07:05,691::BindingXMLRPC::1074::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:07:05,933::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call getCapabilities with () {} flowID [27c082ae] >Thread-13::DEBUG::2014-03-30 11:07:05,934::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-03-30 11:07:05,946::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:05,977::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.11.2.el6.x86_64', 'buildtime': 1393846365.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '0.2.beta2.el6ev', 'buildtime': 1395821236L, 'version': '4.14.5'}, 'qemu-kvm': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.5', 'buildtime': 1393584604L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5410 @ 2.33GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'sw1': {'iface': 'sw1', 'addr': '', 'cfg': {'DEFROUTE': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'sw1', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::215:17ff:fea7:6a4c/64'], 'gateway': '', 'netmask': '', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['bond0']}, 'rhevm': {'iface': 'rhevm', 'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'gateway': '10.35.128.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'sw1': {'addr': '', 'cfg': {'DEFROUTE': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'STP': 'no', 'DEVICE': 'sw1', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::215:17ff:fea7:6a4c/64'], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'ports': ['eth0']}}, 'uuid': '44454C4C-3800-1034-8037-C8C04F4A334A', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4d', 'MASTER': 'bond0', 'DEVICE': 'eth3', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4D', 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'STP': 'no', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4C', 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:50', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:1d:09:68:71:50', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:7150/64'], 'speed': 1000, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:4e', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '00:1d:09:68:71:4e', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.2', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,lahf_lm,dts,tpr_shadow,vnmi,flexpriority,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth2', 'eth3'], 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'BRIDGE': 'sw1', 'NM_CONTROLLED': 'no', 'STP': 'no', 'BONDING_OPTS': 'mode=4 miimon=100', 'DEVICE': 'bond0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7865', 'cpuSpeed': '2327.560', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.28'}} >Thread-13::DEBUG::2014-03-30 11:07:06,050::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call setSafeNetworkConfig with () {} flowID [27c082ae] >Thread-13::DEBUG::2014-03-30 11:07:06,060::BindingXMLRPC::1074::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:07:07,110::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:07,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:07,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450473 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:09,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:09,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369223 s, 27.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:09,799::task::595::TaskManager.Task::(_updateState) Task=`d3a5818b-e46c-414a-8b85-c39ed89d0d11`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:09,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:07:09,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00374363', 'lastCheck': '7.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000434795', 'lastCheck': '4.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:09,799::task::1185::TaskManager.Task::(prepare) Task=`d3a5818b-e46c-414a-8b85-c39ed89d0d11`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00374363', 'lastCheck': '7.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000434795', 'lastCheck': '4.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:09,800::task::595::TaskManager.Task::(_updateState) Task=`d3a5818b-e46c-414a-8b85-c39ed89d0d11`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:09,800::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:09,800::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:09,800::task::990::TaskManager.Task::(_decref) Task=`d3a5818b-e46c-414a-8b85-c39ed89d0d11`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:07:10,122::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:11,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:11,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045345 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:07:12,767::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:07:12,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000591629 s, 6.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:13,134::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:13,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:07:13,893::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:07:13,898::task::595::TaskManager.Task::(_updateState) Task=`5c7b0994-5d39-4430-99b7-7e995cfb2fe4`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:13,901::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Dummy-36::DEBUG::2014-03-30 11:07:13,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450065 s, 22.8 MB/s\n'; <rc> = 0 >Thread-13::INFO::2014-03-30 11:07:13,928::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:13,930::task::1185::TaskManager.Task::(prepare) Task=`5c7b0994-5d39-4430-99b7-7e995cfb2fe4`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:13,932::task::595::TaskManager.Task::(_updateState) Task=`5c7b0994-5d39-4430-99b7-7e995cfb2fe4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:13,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:13,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:13,938::task::990::TaskManager.Task::(_decref) Task=`5c7b0994-5d39-4430-99b7-7e995cfb2fe4`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:07:13,954::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:07:13,955::task::595::TaskManager.Task::(_updateState) Task=`33298446-1c97-47fd-87b1-571f8d003ec9`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:07:13,956::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:07:13,957::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`a3da56cb-3cbe-4604-90e1-fd8488a8b2e6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:07:13,957::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:07:13,958::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:07:13,958::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`a3da56cb-3cbe-4604-90e1-fd8488a8b2e6`::Granted request >Thread-236::DEBUG::2014-03-30 11:07:13,958::task::827::TaskManager.Task::(resourceAcquired) Task=`33298446-1c97-47fd-87b1-571f8d003ec9`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:07:13,959::task::990::TaskManager.Task::(_decref) Task=`33298446-1c97-47fd-87b1-571f8d003ec9`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:07:13,960::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:13,960::task::1185::TaskManager.Task::(prepare) Task=`33298446-1c97-47fd-87b1-571f8d003ec9`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:13,960::task::595::TaskManager.Task::(_updateState) Task=`33298446-1c97-47fd-87b1-571f8d003ec9`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:07:13,960::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:07:13,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:07:13,961::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:07:13,961::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:07:13,961::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:07:13,962::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:07:13,962::task::990::TaskManager.Task::(_decref) Task=`33298446-1c97-47fd-87b1-571f8d003ec9`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:07:15,357::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:15,368::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000463426 s, 747 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:15,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:16,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451147 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:16,161::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:18,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:18,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370482 s, 27.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:07:18,226::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-13::DEBUG::2014-03-30 11:07:18,227::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call setupNetworks with ({'sw1': {'bonding': 'bond0', 'bridged': 'false'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:18,227::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:18,739::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:18,739::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:07:19,186::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-28::DEBUG::2014-03-30 11:07:19,245::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:19,245::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:20,017::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:20,017::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Dummy-36::DEBUG::2014-03-30 11:07:20,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:20,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451748 s, 22.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-03-30 11:07:20,523::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:20,523::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:21,030::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:21,030::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:21,535::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:21,535::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-03-30 11:07:22,041::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call ping with () {} flowID [3c298073] >Thread-28::DEBUG::2014-03-30 11:07:22,041::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-03-30 11:07:22,190::BindingXMLRPC::1074::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >BindingXMLRPC::ERROR::2014-03-30 11:07:22,198::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:22,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:22,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0656677 s, 15.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:22,550::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call getCapabilities with () {} flowID [3c298073] >Thread-13::DEBUG::2014-03-30 11:07:22,551::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-03-30 11:07:22,562::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:22,591::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.11.2.el6.x86_64', 'buildtime': 1393846365.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '0.2.beta2.el6ev', 'buildtime': 1395821236L, 'version': '4.14.5'}, 'qemu-kvm': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.5', 'buildtime': 1393584604L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5410 @ 2.33GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'sw1': {'iface': u'bond0', 'addr': '', 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'bridged': False, 'interface': u'bond0', 'ipv6gateway': '::', 'gateway': ''}, 'rhevm': {'iface': 'rhevm', 'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'gateway': '10.35.128.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'sw1': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'ports': ['eth0']}}, 'uuid': '44454C4C-3800-1034-8037-C8C04F4A334A', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4d', 'MASTER': 'bond0', 'DEVICE': 'eth3', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4D', 'speed': 0, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4C', 'speed': 0, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:50', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:1d:09:68:71:50', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:7150/64'], 'speed': 1000, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:4e', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '00:1d:09:68:71:4e', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.2', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,lahf_lm,dts,tpr_shadow,vnmi,flexpriority,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth2', 'eth3'], 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'DEVICE': 'bond0', 'NM_CONTROLLED': 'no', 'DEFROUTE': 'no', 'ONBOOT': 'yes', 'BONDING_OPTS': 'mode=4 miimon=100'}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7865', 'cpuSpeed': '2327.560', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.162.28'}} >Thread-13::DEBUG::2014-03-30 11:07:22,657::BindingXMLRPC::1067::vds::(wrapper) client [10.35.162.28]::call setSafeNetworkConfig with () {} flowID [3c298073] >Thread-13::DEBUG::2014-03-30 11:07:22,667::BindingXMLRPC::1074::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-03-30 11:07:22,789::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:07:22,805::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.004477 s, 915 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:23,993::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:07:23,994::task::595::TaskManager.Task::(_updateState) Task=`934df1dd-472c-4917-9d2e-aeff1f10822a`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:23,994::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:07:24,020::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:24,025::task::1185::TaskManager.Task::(prepare) Task=`934df1dd-472c-4917-9d2e-aeff1f10822a`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:24,025::task::595::TaskManager.Task::(_updateState) Task=`934df1dd-472c-4917-9d2e-aeff1f10822a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:24,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:24,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:24,026::task::990::TaskManager.Task::(_decref) Task=`934df1dd-472c-4917-9d2e-aeff1f10822a`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:07:24,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:07:24,031::task::595::TaskManager.Task::(_updateState) Task=`a461dbe1-d741-48a2-9689-6c977f8bfb30`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:07:24,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:07:24,032::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b9c3a168-48ab-4e55-97d4-283f65cfb529`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:07:24,032::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:07:24,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:07:24,032::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b9c3a168-48ab-4e55-97d4-283f65cfb529`::Granted request >Thread-236::DEBUG::2014-03-30 11:07:24,033::task::827::TaskManager.Task::(resourceAcquired) Task=`a461dbe1-d741-48a2-9689-6c977f8bfb30`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:07:24,033::task::990::TaskManager.Task::(_decref) Task=`a461dbe1-d741-48a2-9689-6c977f8bfb30`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:07:24,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:24,034::task::1185::TaskManager.Task::(prepare) Task=`a461dbe1-d741-48a2-9689-6c977f8bfb30`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992068136960', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:24,034::task::595::TaskManager.Task::(_updateState) Task=`a461dbe1-d741-48a2-9689-6c977f8bfb30`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:07:24,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:07:24,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:07:24,035::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:07:24,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:07:24,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:07:24,035::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:07:24,035::task::990::TaskManager.Task::(_decref) Task=`a461dbe1-d741-48a2-9689-6c977f8bfb30`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:07:24,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:24,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375447 s, 27.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:24,956::sampling::495::vds::(_getInterfacesStats) Rate above 100%. DEBUG: ifid sw1 interval: 8.13083291054 thisRx 4294964414 thisTx 4294966828 samples [(1396166836.2626481, 2882, 468), (1396166838.2693131, 4154, 468), (1396166840.363549, 0, 0), (1396166842.3788309, 0, 0), (1396166844.393481, 0, 0)] >Thread-13::DEBUG::2014-03-30 11:07:24,957::task::595::TaskManager.Task::(_updateState) Task=`bee524ba-8e3a-4db9-9734-a09b63133511`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:24,957::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:07:24,957::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.004477', 'lastCheck': '2.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463426', 'lastCheck': '9.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:24,957::task::1185::TaskManager.Task::(prepare) Task=`bee524ba-8e3a-4db9-9734-a09b63133511`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.004477', 'lastCheck': '2.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000463426', 'lastCheck': '9.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:24,958::task::595::TaskManager.Task::(_updateState) Task=`bee524ba-8e3a-4db9-9734-a09b63133511`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:24,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:24,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:24,958::task::990::TaskManager.Task::(_decref) Task=`bee524ba-8e3a-4db9-9734-a09b63133511`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:07:25,209::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:07:25,381::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:25,393::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000446135 s, 776 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:26,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:26,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451549 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:28,220::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:28,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:28,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465375 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:30,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:30,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374391 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:31,232::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:07:32,815::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:07:32,832::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00410669 s, 997 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:32,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:33,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372817 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:34,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:07:34,060::task::595::TaskManager.Task::(_updateState) Task=`c89c42eb-4649-4438-a426-d544f37744bf`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:34,060::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:07:34,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:34,081::task::1185::TaskManager.Task::(prepare) Task=`c89c42eb-4649-4438-a426-d544f37744bf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:34,081::task::595::TaskManager.Task::(_updateState) Task=`c89c42eb-4649-4438-a426-d544f37744bf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:34,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:34,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:34,082::task::990::TaskManager.Task::(_decref) Task=`c89c42eb-4649-4438-a426-d544f37744bf`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:07:34,093::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:07:34,095::task::595::TaskManager.Task::(_updateState) Task=`576625fb-1614-4db1-9110-18b1938a4068`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:07:34,097::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:07:34,099::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b37db860-8fa3-4df2-8f25-32a24c49e08a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:07:34,099::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:07:34,099::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:07:34,100::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b37db860-8fa3-4df2-8f25-32a24c49e08a`::Granted request >Thread-236::DEBUG::2014-03-30 11:07:34,100::task::827::TaskManager.Task::(resourceAcquired) Task=`576625fb-1614-4db1-9110-18b1938a4068`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:07:34,100::task::990::TaskManager.Task::(_decref) Task=`576625fb-1614-4db1-9110-18b1938a4068`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:07:34,101::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072429568', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:34,102::task::1185::TaskManager.Task::(prepare) Task=`576625fb-1614-4db1-9110-18b1938a4068`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072429568', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:34,102::task::595::TaskManager.Task::(_updateState) Task=`576625fb-1614-4db1-9110-18b1938a4068`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:07:34,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:07:34,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:07:34,103::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:07:34,103::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:07:34,103::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:07:34,103::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:07:34,103::task::990::TaskManager.Task::(_decref) Task=`576625fb-1614-4db1-9110-18b1938a4068`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:07:34,244::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:35,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:35,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452057 s, 22.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:07:35,404::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:35,415::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000459407 s, 753 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:37,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:07:37,257::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:37,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449709 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:39,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:39,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377526 s, 27.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:40,168::task::595::TaskManager.Task::(_updateState) Task=`275c9f01-acdd-402e-833f-ab097457f6d4`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:40,168::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:07:40,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00410669', 'lastCheck': '7.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459407', 'lastCheck': '4.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:40,169::task::1185::TaskManager.Task::(prepare) Task=`275c9f01-acdd-402e-833f-ab097457f6d4`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00410669', 'lastCheck': '7.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000459407', 'lastCheck': '4.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:40,169::task::595::TaskManager.Task::(_updateState) Task=`275c9f01-acdd-402e-833f-ab097457f6d4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:40,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:40,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:40,170::task::990::TaskManager.Task::(_decref) Task=`275c9f01-acdd-402e-833f-ab097457f6d4`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:07:40,268::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:41,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:41,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452337 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:07:42,841::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:07:42,859::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00463802 s, 883 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:43,280::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:43,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:43,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454146 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:44,368::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:07:44,369::task::595::TaskManager.Task::(_updateState) Task=`0fef7033-e852-4642-94e2-07b9859d18d7`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:44,369::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:07:44,676::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:44,676::task::1185::TaskManager.Task::(prepare) Task=`0fef7033-e852-4642-94e2-07b9859d18d7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:44,676::task::595::TaskManager.Task::(_updateState) Task=`0fef7033-e852-4642-94e2-07b9859d18d7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:44,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:44,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:44,677::task::990::TaskManager.Task::(_decref) Task=`0fef7033-e852-4642-94e2-07b9859d18d7`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:07:44,682::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:07:44,683::task::595::TaskManager.Task::(_updateState) Task=`5eb2cf32-c5ef-45e4-b651-15fcee600226`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:07:44,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:07:44,683::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`aeb6b47d-fed4-4f2e-879e-a7db7ee26772`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:07:44,684::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:07:44,684::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:07:44,684::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`aeb6b47d-fed4-4f2e-879e-a7db7ee26772`::Granted request >Thread-236::DEBUG::2014-03-30 11:07:44,685::task::827::TaskManager.Task::(resourceAcquired) Task=`5eb2cf32-c5ef-45e4-b651-15fcee600226`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:07:44,685::task::990::TaskManager.Task::(_decref) Task=`5eb2cf32-c5ef-45e4-b651-15fcee600226`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:07:44,686::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072429568', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:44,686::task::1185::TaskManager.Task::(prepare) Task=`5eb2cf32-c5ef-45e4-b651-15fcee600226`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072429568', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:44,686::task::595::TaskManager.Task::(_updateState) Task=`5eb2cf32-c5ef-45e4-b651-15fcee600226`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:07:44,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:07:44,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:07:44,687::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:07:44,687::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:07:44,687::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:07:44,688::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:07:44,688::task::990::TaskManager.Task::(_decref) Task=`5eb2cf32-c5ef-45e4-b651-15fcee600226`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:07:45,423::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:45,435::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000437443 s, 791 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:45,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:45,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451922 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:46,293::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:47,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:47,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451245 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:49,304::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:49,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:50,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371442 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:52,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:52,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368806 s, 27.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:52,330::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:07:52,868::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:07:52,885::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00460592 s, 889 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:07:54,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:54,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398496 s, 25.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:55,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:07:55,309::task::595::TaskManager.Task::(_updateState) Task=`dbc9715d-b830-424b-9eea-c5c8dd0821e8`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:55,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:07:55,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:55,332::task::1185::TaskManager.Task::(prepare) Task=`dbc9715d-b830-424b-9eea-c5c8dd0821e8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:07:55,332::task::595::TaskManager.Task::(_updateState) Task=`dbc9715d-b830-424b-9eea-c5c8dd0821e8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:55,333::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:55,333::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:55,333::task::990::TaskManager.Task::(_decref) Task=`dbc9715d-b830-424b-9eea-c5c8dd0821e8`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:07:55,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:07:55,338::task::595::TaskManager.Task::(_updateState) Task=`8572f712-5b81-4dd3-9199-200ee31453f2`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:07:55,339::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:07:55,339::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9be5bea4-0d9c-490d-bd4e-6099248b35ea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:07:55,339::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:07:55,340::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:07:55,340::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9be5bea4-0d9c-490d-bd4e-6099248b35ea`::Granted request >Thread-236::DEBUG::2014-03-30 11:07:55,341::task::827::TaskManager.Task::(resourceAcquired) Task=`8572f712-5b81-4dd3-9199-200ee31453f2`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:07:55,342::task::990::TaskManager.Task::(_decref) Task=`8572f712-5b81-4dd3-9199-200ee31453f2`::ref 1 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:07:55,343::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-236::INFO::2014-03-30 11:07:55,348::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072429568', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:55,349::task::1185::TaskManager.Task::(prepare) Task=`8572f712-5b81-4dd3-9199-200ee31453f2`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072429568', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:07:55,349::task::595::TaskManager.Task::(_updateState) Task=`8572f712-5b81-4dd3-9199-200ee31453f2`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:07:55,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:07:55,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:07:55,350::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:07:55,350::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:07:55,350::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:07:55,350::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:07:55,350::task::990::TaskManager.Task::(_decref) Task=`8572f712-5b81-4dd3-9199-200ee31453f2`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:07:55,446::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:07:55,458::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000458197 s, 755 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:07:55,506::task::595::TaskManager.Task::(_updateState) Task=`851f0b77-2cd0-4aa5-8cb9-151f10d6b2bd`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:07:55,506::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:07:55,506::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00460592', 'lastCheck': '2.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458197', 'lastCheck': '0.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:55,507::task::1185::TaskManager.Task::(prepare) Task=`851f0b77-2cd0-4aa5-8cb9-151f10d6b2bd`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00460592', 'lastCheck': '2.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458197', 'lastCheck': '0.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:07:55,507::task::595::TaskManager.Task::(_updateState) Task=`851f0b77-2cd0-4aa5-8cb9-151f10d6b2bd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:07:55,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:07:55,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:07:55,508::task::990::TaskManager.Task::(_decref) Task=`851f0b77-2cd0-4aa5-8cb9-151f10d6b2bd`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:07:56,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:56,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454126 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:07:58,354::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:07:58,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:07:58,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450795 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:00,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:00,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370307 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:01,366::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:02,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:02,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449347 s, 22.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:08:02,894::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:02,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000581249 s, 7.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:04,377::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:04,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:04,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372287 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:05,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:08:05,378::task::595::TaskManager.Task::(_updateState) Task=`7ac0087a-5f31-47d6-864d-731ea1d3247b`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:05,378::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:08:05,390::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:05,390::task::1185::TaskManager.Task::(prepare) Task=`7ac0087a-5f31-47d6-864d-731ea1d3247b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:05,391::task::595::TaskManager.Task::(_updateState) Task=`7ac0087a-5f31-47d6-864d-731ea1d3247b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:05,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:05,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:05,391::task::990::TaskManager.Task::(_decref) Task=`7ac0087a-5f31-47d6-864d-731ea1d3247b`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:08:05,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:08:05,398::task::595::TaskManager.Task::(_updateState) Task=`e85e8063-ca8b-4b23-9250-d576d24e2cab`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:08:05,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:08:05,399::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3a0039ab-72e8-40ca-b06b-3dbd2f638b75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:08:05,399::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:08:05,399::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:08:05,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3a0039ab-72e8-40ca-b06b-3dbd2f638b75`::Granted request >Thread-236::DEBUG::2014-03-30 11:08:05,400::task::827::TaskManager.Task::(resourceAcquired) Task=`e85e8063-ca8b-4b23-9250-d576d24e2cab`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:08:05,400::task::990::TaskManager.Task::(_decref) Task=`e85e8063-ca8b-4b23-9250-d576d24e2cab`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:08:05,402::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:05,402::task::1185::TaskManager.Task::(prepare) Task=`e85e8063-ca8b-4b23-9250-d576d24e2cab`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:05,402::task::595::TaskManager.Task::(_updateState) Task=`e85e8063-ca8b-4b23-9250-d576d24e2cab`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:08:05,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:08:05,403::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:08:05,403::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:08:05,403::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:08:05,403::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:08:05,403::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:08:05,404::task::990::TaskManager.Task::(_decref) Task=`e85e8063-ca8b-4b23-9250-d576d24e2cab`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:08:05,468::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:08:05,480::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000373296 s, 927 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:06,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:07,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370975 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:07,389::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-815::DEBUG::2014-03-30 11:08:07,407::BindingXMLRPC::1067::vds::(wrapper) client [10.35.128.10]::call getCapabilities with () {} >Thread-815::DEBUG::2014-03-30 11:08:07,408::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-815::DEBUG::2014-03-30 11:08:07,418::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-815::DEBUG::2014-03-30 11:08:07,447::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.11.2.el6.x86_64', 'buildtime': 1393846365.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '0.2.beta2.el6ev', 'buildtime': 1395821236L, 'version': '4.14.5'}, 'qemu-kvm': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.5', 'buildtime': 1393584604L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.6', 'buildtime': 1393935192L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6ev', 'buildtime': 1392224015L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5410 @ 2.33GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'sw1': {'iface': u'bond0', 'addr': '', 'ipv6addrs': ['fe80::215:17ff:fea7:6a4c/64'], 'mtu': '1500', 'netmask': '', 'bridged': False, 'interface': u'bond0', 'ipv6gateway': '::', 'gateway': ''}, 'rhevm': {'iface': 'rhevm', 'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'gateway': '10.35.128.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'sw1': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': ['bond0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.128.10', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.128.254', 'ports': ['eth0']}}, 'uuid': '44454C4C-3800-1034-8037-C8C04F4A334A', 'lastClientIface': 'rhevm', 'nics': {'eth3': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4d', 'MASTER': 'bond0', 'DEVICE': 'eth3', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4D', 'speed': 1000, 'mtu': '1500'}, 'eth2': {'netmask': '', 'addr': '', 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'SLAVE': 'yes', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:15:17:a7:6a:4c', 'MASTER': 'bond0', 'DEVICE': 'eth2', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'permhwaddr': '00:15:17:A7:6A:4C', 'speed': 1000, 'mtu': '1500'}, 'eth1': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:50', 'cfg': {'DEVICE': 'eth1', 'HWADDR': '00:1d:09:68:71:50', 'ONBOOT': 'yes', 'MTU': '1500'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:7150/64'], 'speed': 1000, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '00:1d:09:68:71:4e', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '00:1d:09:68:71:4e', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21d:9ff:fe68:714e/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.2', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,cx16,xtpr,pdcm,dca,sse4_1,lahf_lm,dts,tpr_shadow,vnmi,flexpriority,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:silver-vdsa', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': ['eth2', 'eth3'], 'hwaddr': '00:15:17:a7:6a:4c', 'cfg': {'DEVICE': 'bond0', 'NM_CONTROLLED': 'no', 'DEFROUTE': 'no', 'ONBOOT': 'yes', 'BONDING_OPTS': 'mode=4 miimon=100'}, 'ipv6addrs': ['fe80::215:17ff:fea7:6a4c/64'], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '7865', 'cpuSpeed': '2327.560', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.128.10'}} >Dummy-36::DEBUG::2014-03-30 11:08:09,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:09,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376169 s, 27.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:10,403::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:08:11,105::task::595::TaskManager.Task::(_updateState) Task=`d0f43c97-cb81-4477-b8a8-98927d712fed`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:11,106::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:08:11,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581249', 'lastCheck': '8.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000373296', 'lastCheck': '5.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:11,106::task::1185::TaskManager.Task::(prepare) Task=`d0f43c97-cb81-4477-b8a8-98927d712fed`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000581249', 'lastCheck': '8.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000373296', 'lastCheck': '5.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:11,106::task::595::TaskManager.Task::(_updateState) Task=`d0f43c97-cb81-4477-b8a8-98927d712fed`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:11,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:11,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:11,107::task::990::TaskManager.Task::(_decref) Task=`d0f43c97-cb81-4477-b8a8-98927d712fed`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:11,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:11,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448919 s, 22.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:08:12,912::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:08:12,913::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:08:12,913::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::DEBUG::2014-03-30 11:08:12,913::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:08:12,918::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:12,928::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000520351 s, 3.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:08:12,929::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000520351 s, 3.9 MB/s'], size: 2048 >Thread-14::DEBUG::2014-03-30 11:08:12,929::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-03-30 11:08:12,929::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-03-30 11:08:12,930::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:08:12,930::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:08:12,930::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:08:12,931::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:08:12,931::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:08:12,931::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:08:12,932::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000567e404977a4e311|/dev/mapper/360060160f4a03000da2233488fa4e311|/dev/mapper/360060160f4a03000e86588568fa4e311|/dev/mapper/360060160f4a03000f8d72cd38ca4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:13,240::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:08:13,243::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:08:13,244::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=wxY9cX-001T-eqwx-zf7D-Yhcl-2Uwh-KUR3m6', 'LOCKPOLICY=', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:360060160f4a03000da2233488fa4e311,uuid:Qj89Z4-DLwY-sR5F-gGtn-bLRy-SNKX-2ho7ew,pestart:0,pecount:557,mapoffset:0', 'LEASERETRIES=3', 'SDUUID=dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'CLASS=Data', 'DESCRIPTION=Imp_Exp_DC0_data_domain0', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Imp_Exp_DC0', 'ROLE=Master', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', u'POOL_DOMAINS=dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=2', '_SHA_CKSUM=db97a5e6891143b5e26a4bf2aacf0ba3b85f20a6'] >Thread-14::INFO::2014-03-30 11:08:13,245::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_imageNS already registered >Thread-14::INFO::2014-03-30 11:08:13,245::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_volumeNS already registered >Thread-14::INFO::2014-03-30 11:08:13,245::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_lvmActivationNS already registered >Thread-14::DEBUG::2014-03-30 11:08:13,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000da2233488fa4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:13,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:13,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451357 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:08:13,414::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:13,415::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:08:13,424::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:13,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556652 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:15,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:08:15,502::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [2d018cbd] >Thread-13::DEBUG::2014-03-30 11:08:15,510::task::595::TaskManager.Task::(_updateState) Task=`2ee71d0c-a6b0-4bb1-b643-b1caab65a10c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:15,515::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:08:15,545::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:15,550::task::1185::TaskManager.Task::(prepare) Task=`2ee71d0c-a6b0-4bb1-b643-b1caab65a10c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:15,554::task::595::TaskManager.Task::(_updateState) Task=`2ee71d0c-a6b0-4bb1-b643-b1caab65a10c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:15,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:15,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-36::DEBUG::2014-03-30 11:08:15,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373116 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:15,566::task::990::TaskManager.Task::(_decref) Task=`2ee71d0c-a6b0-4bb1-b643-b1caab65a10c`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:08:15,583::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-236::DEBUG::2014-03-30 11:08:15,601::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [2d018cbd] >Thread-236::DEBUG::2014-03-30 11:08:15,608::task::595::TaskManager.Task::(_updateState) Task=`0eb9a195-39aa-48cb-bc3b-9cfc5f193909`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:08:15,613::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:08:15,622::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e424ac89-1546-49fe-98ba-798eb853bcd6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:08:15,625::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:08:15,630::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:08:15,633::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e424ac89-1546-49fe-98ba-798eb853bcd6`::Granted request >Thread-15::DEBUG::2014-03-30 11:08:15,634::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000405829 s, 853 kB/s\n'; <rc> = 0 >Thread-236::DEBUG::2014-03-30 11:08:15,643::task::827::TaskManager.Task::(resourceAcquired) Task=`0eb9a195-39aa-48cb-bc3b-9cfc5f193909`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:08:15,647::task::990::TaskManager.Task::(_decref) Task=`0eb9a195-39aa-48cb-bc3b-9cfc5f193909`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:08:15,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:15,661::task::1185::TaskManager.Task::(prepare) Task=`0eb9a195-39aa-48cb-bc3b-9cfc5f193909`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072396800', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:15,662::task::595::TaskManager.Task::(_updateState) Task=`0eb9a195-39aa-48cb-bc3b-9cfc5f193909`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:08:15,664::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:08:15,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:08:15,669::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:08:15,671::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:08:15,672::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:08:15,674::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:08:15,676::task::990::TaskManager.Task::(_decref) Task=`0eb9a195-39aa-48cb-bc3b-9cfc5f193909`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:08:16,428::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:17,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:17,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451177 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:19,440::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:19,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:19,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368642 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:21,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:22,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372117 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:22,458::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:08:23,447::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:23,460::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539074 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:24,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:24,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375345 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:25,469::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:08:25,662::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:08:25,674::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000373755 s, 926 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:25,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:08:25,783::task::595::TaskManager.Task::(_updateState) Task=`ca3c005d-f673-4cd8-bcb6-5440bbd78caf`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:25,784::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:08:25,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:25,813::task::1185::TaskManager.Task::(prepare) Task=`ca3c005d-f673-4cd8-bcb6-5440bbd78caf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:25,813::task::595::TaskManager.Task::(_updateState) Task=`ca3c005d-f673-4cd8-bcb6-5440bbd78caf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:25,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:25,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:25,814::task::990::TaskManager.Task::(_decref) Task=`ca3c005d-f673-4cd8-bcb6-5440bbd78caf`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:08:25,824::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:08:25,825::task::595::TaskManager.Task::(_updateState) Task=`0b5e158e-75f6-42ac-b794-10e407dd3e6b`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:08:25,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:08:25,826::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`72d786be-cc2f-4ade-8e58-8fa76be665c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:08:25,826::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:08:25,826::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:08:25,827::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`72d786be-cc2f-4ade-8e58-8fa76be665c7`::Granted request >Thread-236::DEBUG::2014-03-30 11:08:25,827::task::827::TaskManager.Task::(resourceAcquired) Task=`0b5e158e-75f6-42ac-b794-10e407dd3e6b`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:08:25,827::task::990::TaskManager.Task::(_decref) Task=`0b5e158e-75f6-42ac-b794-10e407dd3e6b`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:08:25,828::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072364032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:25,829::task::1185::TaskManager.Task::(prepare) Task=`0b5e158e-75f6-42ac-b794-10e407dd3e6b`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992072364032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:25,829::task::595::TaskManager.Task::(_updateState) Task=`0b5e158e-75f6-42ac-b794-10e407dd3e6b`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:08:25,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:08:25,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:08:25,829::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:08:25,830::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:08:25,830::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:08:25,830::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:08:25,830::task::990::TaskManager.Task::(_decref) Task=`0b5e158e-75f6-42ac-b794-10e407dd3e6b`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:26,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:08:26,271::task::595::TaskManager.Task::(_updateState) Task=`b69719bd-3f56-4c82-924d-a78983ea30b0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:26,273::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:08:26,275::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539074', 'lastCheck': '2.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000373755', 'lastCheck': '0.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:26,276::task::1185::TaskManager.Task::(prepare) Task=`b69719bd-3f56-4c82-924d-a78983ea30b0`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539074', 'lastCheck': '2.8', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000373755', 'lastCheck': '0.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:26,277::task::595::TaskManager.Task::(_updateState) Task=`b69719bd-3f56-4c82-924d-a78983ea30b0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:26,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:26,280::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:26,282::task::990::TaskManager.Task::(_decref) Task=`b69719bd-3f56-4c82-924d-a78983ea30b0`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:26,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451879 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:28,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:28,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0514164 s, 19.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:28,481::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:30,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:30,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374941 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:31,493::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:32,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:32,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450735 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:08:33,468::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:33,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548743 s, 7.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:34,505::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:34,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:34,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455654 s, 22.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:08:35,685::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:08:35,697::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000442473 s, 782 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:35,861::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:08:35,862::task::595::TaskManager.Task::(_updateState) Task=`f5316a0c-a4c0-4cc7-b33c-1b9b7cdd7135`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:35,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:08:35,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:35,886::task::1185::TaskManager.Task::(prepare) Task=`f5316a0c-a4c0-4cc7-b33c-1b9b7cdd7135`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:35,886::task::595::TaskManager.Task::(_updateState) Task=`f5316a0c-a4c0-4cc7-b33c-1b9b7cdd7135`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:35,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:35,887::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:35,887::task::990::TaskManager.Task::(_decref) Task=`f5316a0c-a4c0-4cc7-b33c-1b9b7cdd7135`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:08:35,895::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:08:35,895::task::595::TaskManager.Task::(_updateState) Task=`1b51d072-932c-4827-afaf-6b5affe01f48`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:08:35,895::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:08:35,897::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`133a962f-6521-4f29-a88b-62a07f6a8d49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:08:35,897::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:08:35,897::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:08:35,897::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`133a962f-6521-4f29-a88b-62a07f6a8d49`::Granted request >Thread-236::DEBUG::2014-03-30 11:08:35,898::task::827::TaskManager.Task::(resourceAcquired) Task=`1b51d072-932c-4827-afaf-6b5affe01f48`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:08:35,898::task::990::TaskManager.Task::(_decref) Task=`1b51d072-932c-4827-afaf-6b5affe01f48`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:08:35,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992071118848', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:35,899::task::1185::TaskManager.Task::(prepare) Task=`1b51d072-932c-4827-afaf-6b5affe01f48`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '1992071118848', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:35,899::task::595::TaskManager.Task::(_updateState) Task=`1b51d072-932c-4827-afaf-6b5affe01f48`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:08:35,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:08:35,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:08:35,900::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:08:35,900::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:08:35,901::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:08:35,901::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:08:35,901::task::990::TaskManager.Task::(_decref) Task=`1b51d072-932c-4827-afaf-6b5affe01f48`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:36,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:37,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.319405 s, 3.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:37,518::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:39,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:39,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373463 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:40,530::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:41,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:41,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452191 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:41,455::task::595::TaskManager.Task::(_updateState) Task=`99e35ac4-7f7a-4e87-a748-3ad9b7b2336c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:41,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:08:41,456::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548743', 'lastCheck': '8.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442473', 'lastCheck': '5.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:41,456::task::1185::TaskManager.Task::(prepare) Task=`99e35ac4-7f7a-4e87-a748-3ad9b7b2336c`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000548743', 'lastCheck': '8.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000442473', 'lastCheck': '5.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:41,456::task::595::TaskManager.Task::(_updateState) Task=`99e35ac4-7f7a-4e87-a748-3ad9b7b2336c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:41,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:41,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:41,457::task::990::TaskManager.Task::(_decref) Task=`99e35ac4-7f7a-4e87-a748-3ad9b7b2336c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:43,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:43,511::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:08:43,544::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:08:43,581::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00417881 s, 980 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:43,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.171119 s, 6.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:08:45,707::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:45,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-03-30 11:08:45,730::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000442558 s, 782 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:45,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045227 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:46,010::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:08:46,011::task::595::TaskManager.Task::(_updateState) Task=`a2c4dc1d-2d7c-4dcc-9cd3-f1c2437f5c65`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:46,011::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:08:46,023::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:46,023::task::1185::TaskManager.Task::(prepare) Task=`a2c4dc1d-2d7c-4dcc-9cd3-f1c2437f5c65`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:46,024::task::595::TaskManager.Task::(_updateState) Task=`a2c4dc1d-2d7c-4dcc-9cd3-f1c2437f5c65`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:46,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:46,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:46,024::task::990::TaskManager.Task::(_decref) Task=`a2c4dc1d-2d7c-4dcc-9cd3-f1c2437f5c65`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:08:46,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:08:46,031::task::595::TaskManager.Task::(_updateState) Task=`627f687f-145c-4b64-811c-4e1edda6ac0d`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:08:46,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:08:46,032::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bd1f3066-e414-44c9-8f61-239f39e8a4e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:08:46,032::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:08:46,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:08:46,033::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bd1f3066-e414-44c9-8f61-239f39e8a4e1`::Granted request >Thread-236::DEBUG::2014-03-30 11:08:46,033::task::827::TaskManager.Task::(resourceAcquired) Task=`627f687f-145c-4b64-811c-4e1edda6ac0d`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:08:46,033::task::990::TaskManager.Task::(_decref) Task=`627f687f-145c-4b64-811c-4e1edda6ac0d`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:08:46,035::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003886080000', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:46,035::task::1185::TaskManager.Task::(prepare) Task=`627f687f-145c-4b64-811c-4e1edda6ac0d`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003886080000', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:46,035::task::595::TaskManager.Task::(_updateState) Task=`627f687f-145c-4b64-811c-4e1edda6ac0d`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:08:46,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:08:46,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:08:46,036::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:08:46,036::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:08:46,036::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:08:46,036::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:08:46,037::task::990::TaskManager.Task::(_decref) Task=`627f687f-145c-4b64-811c-4e1edda6ac0d`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:08:46,555::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:47,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:47,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455191 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:49,566::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:08:49,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:50,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372322 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:52,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:52,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382646 s, 26.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:52,578::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:08:53,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:08:53,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800315 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:08:54,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:54,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041275 s, 24.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:55,589::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:08:55,742::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:08:55,754::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000385104 s, 898 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:56,062::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:08:56,063::task::595::TaskManager.Task::(_updateState) Task=`6ade55f7-a072-401a-9403-fd3495ef65fd`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:56,063::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:08:56,091::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:56,091::task::1185::TaskManager.Task::(prepare) Task=`6ade55f7-a072-401a-9403-fd3495ef65fd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:08:56,091::task::595::TaskManager.Task::(_updateState) Task=`6ade55f7-a072-401a-9403-fd3495ef65fd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:56,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:56,092::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:56,092::task::990::TaskManager.Task::(_decref) Task=`6ade55f7-a072-401a-9403-fd3495ef65fd`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:08:56,098::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:08:56,098::task::595::TaskManager.Task::(_updateState) Task=`61d4d13f-29cc-49bf-93df-da2d8bc513cc`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:08:56,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:08:56,099::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ae6d25b6-b3e7-4530-9596-e86f2868a717`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:08:56,099::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:08:56,100::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:08:56,100::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ae6d25b6-b3e7-4530-9596-e86f2868a717`::Granted request >Thread-236::DEBUG::2014-03-30 11:08:56,100::task::827::TaskManager.Task::(resourceAcquired) Task=`61d4d13f-29cc-49bf-93df-da2d8bc513cc`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:08:56,101::task::990::TaskManager.Task::(_decref) Task=`61d4d13f-29cc-49bf-93df-da2d8bc513cc`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:08:56,102::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003883393024', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:56,102::task::1185::TaskManager.Task::(prepare) Task=`61d4d13f-29cc-49bf-93df-da2d8bc513cc`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003883393024', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:08:56,102::task::595::TaskManager.Task::(_updateState) Task=`61d4d13f-29cc-49bf-93df-da2d8bc513cc`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:08:56,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:08:56,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:08:56,103::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:08:56,103::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:08:56,103::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:08:56,103::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:08:56,104::task::990::TaskManager.Task::(_decref) Task=`61d4d13f-29cc-49bf-93df-da2d8bc513cc`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:56,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:56,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479147 s, 21.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:08:56,602::task::595::TaskManager.Task::(_updateState) Task=`cddce1eb-1abe-4b37-8cdb-3759251435f3`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:08:56,603::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:08:56,603::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800315', 'lastCheck': '3.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385104', 'lastCheck': '0.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:56,603::task::1185::TaskManager.Task::(prepare) Task=`cddce1eb-1abe-4b37-8cdb-3759251435f3`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800315', 'lastCheck': '3.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000385104', 'lastCheck': '0.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:08:56,603::task::595::TaskManager.Task::(_updateState) Task=`cddce1eb-1abe-4b37-8cdb-3759251435f3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:08:56,604::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:08:56,604::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:08:56,604::task::990::TaskManager.Task::(_decref) Task=`cddce1eb-1abe-4b37-8cdb-3759251435f3`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:08:58,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:08:58,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0517199 s, 19.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:08:58,602::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:00,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:00,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465317 s, 22.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:01,613::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:02,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:02,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500444 s, 20.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:09:03,648::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:09:03,667::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0061212 s, 669 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:04,625::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:04,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:04,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453217 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:09:05,765::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:09:05,776::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000456779 s, 757 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:06,128::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4b2a6040] >Thread-13::DEBUG::2014-03-30 11:09:06,128::task::595::TaskManager.Task::(_updateState) Task=`1b74541c-cf84-4bea-b9dc-0f022f05d608`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:06,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:09:06,150::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:06,150::task::1185::TaskManager.Task::(prepare) Task=`1b74541c-cf84-4bea-b9dc-0f022f05d608`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:06,150::task::595::TaskManager.Task::(_updateState) Task=`1b74541c-cf84-4bea-b9dc-0f022f05d608`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:06,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:06,151::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:06,151::task::990::TaskManager.Task::(_decref) Task=`1b74541c-cf84-4bea-b9dc-0f022f05d608`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:09:06,156::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4b2a6040] >Thread-236::DEBUG::2014-03-30 11:09:06,157::task::595::TaskManager.Task::(_updateState) Task=`ea98fc74-9564-4d5b-baf0-e749e45246e7`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:09:06,157::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:09:06,158::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6d30bc0d-1cbc-4ad4-b791-d2648687d7e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:09:06,158::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:09:06,158::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:09:06,158::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6d30bc0d-1cbc-4ad4-b791-d2648687d7e5`::Granted request >Thread-236::DEBUG::2014-03-30 11:09:06,159::task::827::TaskManager.Task::(resourceAcquired) Task=`ea98fc74-9564-4d5b-baf0-e749e45246e7`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:09:06,159::task::990::TaskManager.Task::(_decref) Task=`ea98fc74-9564-4d5b-baf0-e749e45246e7`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:09:06,160::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003883098112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:06,160::task::1185::TaskManager.Task::(prepare) Task=`ea98fc74-9564-4d5b-baf0-e749e45246e7`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003883098112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:06,160::task::595::TaskManager.Task::(_updateState) Task=`ea98fc74-9564-4d5b-baf0-e749e45246e7`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:09:06,160::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:09:06,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:09:06,161::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:09:06,161::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:09:06,161::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:09:06,161::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:09:06,162::task::990::TaskManager.Task::(_decref) Task=`ea98fc74-9564-4d5b-baf0-e749e45246e7`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:09:06,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:07,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370366 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:07,636::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:09,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:09,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371521 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:10,649::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:11,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:11,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454015 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:11,759::task::595::TaskManager.Task::(_updateState) Task=`737babc3-3337-4ce5-a3ff-210d349fa143`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:11,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:09:11,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0061212', 'lastCheck': '8.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456779', 'lastCheck': '6.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:11,760::task::1185::TaskManager.Task::(prepare) Task=`737babc3-3337-4ce5-a3ff-210d349fa143`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0061212', 'lastCheck': '8.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000456779', 'lastCheck': '6.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:11,760::task::595::TaskManager.Task::(_updateState) Task=`737babc3-3337-4ce5-a3ff-210d349fa143`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:11,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:11,761::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:11,761::task::990::TaskManager.Task::(_decref) Task=`737babc3-3337-4ce5-a3ff-210d349fa143`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:09:13,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:13,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452883 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:13,660::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:09:13,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:09:13,689::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594291 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:15,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:15,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376176 s, 27.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:09:15,788::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:09:15,799::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000441024 s, 785 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:16,196::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:09:16,196::task::595::TaskManager.Task::(_updateState) Task=`0de64f4a-f764-48f3-945b-0ab7afa43024`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:16,197::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:09:16,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:16,209::task::1185::TaskManager.Task::(prepare) Task=`0de64f4a-f764-48f3-945b-0ab7afa43024`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:16,209::task::595::TaskManager.Task::(_updateState) Task=`0de64f4a-f764-48f3-945b-0ab7afa43024`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:16,209::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:16,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:16,210::task::990::TaskManager.Task::(_decref) Task=`0de64f4a-f764-48f3-945b-0ab7afa43024`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:09:16,217::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:09:16,217::task::595::TaskManager.Task::(_updateState) Task=`46de5138-9808-4ddb-a702-4eaa9728b300`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:09:16,217::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:09:16,218::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`4f2fbd16-986f-4562-be6c-d9b89c0ac133`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:09:16,218::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:09:16,218::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:09:16,219::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`4f2fbd16-986f-4562-be6c-d9b89c0ac133`::Granted request >Thread-236::DEBUG::2014-03-30 11:09:16,219::task::827::TaskManager.Task::(resourceAcquired) Task=`46de5138-9808-4ddb-a702-4eaa9728b300`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:09:16,219::task::990::TaskManager.Task::(_decref) Task=`46de5138-9808-4ddb-a702-4eaa9728b300`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:09:16,220::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003883098112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:16,221::task::1185::TaskManager.Task::(prepare) Task=`46de5138-9808-4ddb-a702-4eaa9728b300`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003883098112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:16,221::task::595::TaskManager.Task::(_updateState) Task=`46de5138-9808-4ddb-a702-4eaa9728b300`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:09:16,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:09:16,221::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:09:16,222::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:09:16,222::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:09:16,222::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:09:16,222::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:09:16,222::task::990::TaskManager.Task::(_decref) Task=`46de5138-9808-4ddb-a702-4eaa9728b300`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:09:16,672::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:17,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:17,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450808 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:19,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:09:19,689::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:19,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371108 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:21,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:21,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370415 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:22,702::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:09:23,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:09:23,717::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00544643 s, 752 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:23,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:24,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454722 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:25,713::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:09:25,810::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:09:25,822::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000371358 s, 932 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:26,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:26,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451675 s, 22.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:26,256::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-13::DEBUG::2014-03-30 11:09:26,257::task::595::TaskManager.Task::(_updateState) Task=`6428e3a5-73db-4140-9407-db460ffd4fbd`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:26,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:09:26,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:26,284::task::1185::TaskManager.Task::(prepare) Task=`6428e3a5-73db-4140-9407-db460ffd4fbd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:26,285::task::595::TaskManager.Task::(_updateState) Task=`6428e3a5-73db-4140-9407-db460ffd4fbd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:26,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:26,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:26,285::task::990::TaskManager.Task::(_decref) Task=`6428e3a5-73db-4140-9407-db460ffd4fbd`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:09:26,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-236::DEBUG::2014-03-30 11:09:26,292::task::595::TaskManager.Task::(_updateState) Task=`89d8ff87-5bae-4037-ab52-3ffc4b565677`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:09:26,293::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:09:26,293::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`212442d3-3619-4a0b-ac15-e322f87bb42d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:09:26,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:09:26,294::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:09:26,294::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`212442d3-3619-4a0b-ac15-e322f87bb42d`::Granted request >Thread-236::DEBUG::2014-03-30 11:09:26,294::task::827::TaskManager.Task::(resourceAcquired) Task=`89d8ff87-5bae-4037-ab52-3ffc4b565677`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:09:26,295::task::990::TaskManager.Task::(_decref) Task=`89d8ff87-5bae-4037-ab52-3ffc4b565677`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:09:26,296::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003880640512', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:26,296::task::1185::TaskManager.Task::(prepare) Task=`89d8ff87-5bae-4037-ab52-3ffc4b565677`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003880640512', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:26,296::task::595::TaskManager.Task::(_updateState) Task=`89d8ff87-5bae-4037-ab52-3ffc4b565677`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:09:26,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:09:26,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:09:26,297::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:09:26,297::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:09:26,297::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:09:26,298::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:09:26,298::task::990::TaskManager.Task::(_decref) Task=`89d8ff87-5bae-4037-ab52-3ffc4b565677`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:09:26,927::task::595::TaskManager.Task::(_updateState) Task=`4ea920c9-a6e7-4b9d-b5ad-76410a4ee282`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:26,927::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:09:26,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00544643', 'lastCheck': '3.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000371358', 'lastCheck': '1.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:26,928::task::1185::TaskManager.Task::(prepare) Task=`4ea920c9-a6e7-4b9d-b5ad-76410a4ee282`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00544643', 'lastCheck': '3.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000371358', 'lastCheck': '1.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:26,928::task::595::TaskManager.Task::(_updateState) Task=`4ea920c9-a6e7-4b9d-b5ad-76410a4ee282`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:26,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:26,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:26,929::task::990::TaskManager.Task::(_decref) Task=`4ea920c9-a6e7-4b9d-b5ad-76410a4ee282`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:09:28,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:28,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451801 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:28,726::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:30,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:30,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372858 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:31,737::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:32,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:32,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04604 s, 22.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:09:33,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:09:33,747::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0101669 s, 403 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:34,749::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:34,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:34,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0823373 s, 12.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:09:35,832::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:09:35,844::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000431905 s, 801 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:36,328::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:09:36,329::task::595::TaskManager.Task::(_updateState) Task=`355c51a3-e659-4024-8091-f19a7b0e0424`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:36,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:09:36,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:36,355::task::1185::TaskManager.Task::(prepare) Task=`355c51a3-e659-4024-8091-f19a7b0e0424`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:36,355::task::595::TaskManager.Task::(_updateState) Task=`355c51a3-e659-4024-8091-f19a7b0e0424`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:36,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:36,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:36,356::task::990::TaskManager.Task::(_decref) Task=`355c51a3-e659-4024-8091-f19a7b0e0424`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:09:36,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:09:36,361::task::595::TaskManager.Task::(_updateState) Task=`247e9385-2b97-4bdc-a21e-6c07bc026d8c`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:09:36,361::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:09:36,362::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`917789a2-5691-405e-973e-8eb861dc821a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:09:36,362::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:09:36,362::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:09:36,362::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`917789a2-5691-405e-973e-8eb861dc821a`::Granted request >Thread-236::DEBUG::2014-03-30 11:09:36,363::task::827::TaskManager.Task::(resourceAcquired) Task=`247e9385-2b97-4bdc-a21e-6c07bc026d8c`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:09:36,363::task::990::TaskManager.Task::(_decref) Task=`247e9385-2b97-4bdc-a21e-6c07bc026d8c`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:09:36,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878477824', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:36,364::task::1185::TaskManager.Task::(prepare) Task=`247e9385-2b97-4bdc-a21e-6c07bc026d8c`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878477824', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:36,364::task::595::TaskManager.Task::(_updateState) Task=`247e9385-2b97-4bdc-a21e-6c07bc026d8c`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:09:36,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:09:36,364::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:09:36,365::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:09:36,365::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:09:36,365::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:09:36,365::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:09:36,365::task::990::TaskManager.Task::(_decref) Task=`247e9385-2b97-4bdc-a21e-6c07bc026d8c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:09:36,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:37,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374849 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:37,764::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:39,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:39,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372208 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:40,775::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:41,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:41,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451446 s, 22.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:42,105::task::595::TaskManager.Task::(_updateState) Task=`386bdded-3223-45ee-a2e3-0215c64d3eff`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:42,105::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:09:42,106::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0101669', 'lastCheck': '8.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431905', 'lastCheck': '6.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:42,106::task::1185::TaskManager.Task::(prepare) Task=`386bdded-3223-45ee-a2e3-0215c64d3eff`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0101669', 'lastCheck': '8.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431905', 'lastCheck': '6.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:42,106::task::595::TaskManager.Task::(_updateState) Task=`386bdded-3223-45ee-a2e3-0215c64d3eff`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:42,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:42,106::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:42,106::task::990::TaskManager.Task::(_decref) Task=`386bdded-3223-45ee-a2e3-0215c64d3eff`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:09:43,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:43,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452185 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:09:43,756::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:09:43,778::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00954982 s, 429 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:43,788::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:45,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:45,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370692 s, 27.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:09:45,855::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:09:45,866::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000447108 s, 774 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:46,544::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:09:46,545::task::595::TaskManager.Task::(_updateState) Task=`ac6524f2-fd2d-42a8-b467-ad0220007b78`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:46,545::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:09:46,573::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:46,573::task::1185::TaskManager.Task::(prepare) Task=`ac6524f2-fd2d-42a8-b467-ad0220007b78`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:46,573::task::595::TaskManager.Task::(_updateState) Task=`ac6524f2-fd2d-42a8-b467-ad0220007b78`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:46,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:46,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:46,574::task::990::TaskManager.Task::(_decref) Task=`ac6524f2-fd2d-42a8-b467-ad0220007b78`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:09:46,581::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:09:46,581::task::595::TaskManager.Task::(_updateState) Task=`4e0e966c-2bc5-44a5-8ec3-e8bff4a6c19f`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:09:46,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:09:46,582::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`7cf2f963-ffc6-47df-828a-3db07bd7cb98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:09:46,583::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:09:46,583::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:09:46,583::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`7cf2f963-ffc6-47df-828a-3db07bd7cb98`::Granted request >Thread-236::DEBUG::2014-03-30 11:09:46,584::task::827::TaskManager.Task::(resourceAcquired) Task=`4e0e966c-2bc5-44a5-8ec3-e8bff4a6c19f`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:09:46,584::task::990::TaskManager.Task::(_decref) Task=`4e0e966c-2bc5-44a5-8ec3-e8bff4a6c19f`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:09:46,585::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878477824', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:46,585::task::1185::TaskManager.Task::(prepare) Task=`4e0e966c-2bc5-44a5-8ec3-e8bff4a6c19f`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878477824', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:46,585::task::595::TaskManager.Task::(_updateState) Task=`4e0e966c-2bc5-44a5-8ec3-e8bff4a6c19f`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:09:46,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:09:46,586::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:09:46,586::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:09:46,586::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:09:46,586::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:09:46,587::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:09:46,587::task::990::TaskManager.Task::(_decref) Task=`4e0e966c-2bc5-44a5-8ec3-e8bff4a6c19f`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:09:46,800::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:47,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:47,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456183 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:49,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:49,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381163 s, 26.9 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:49,812::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:09:51,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:51,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371708 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:52,825::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:09:53,787::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:09:53,805::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00492323 s, 832 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:53,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:54,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454621 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:55,836::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:09:55,876::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:09:55,887::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000443463 s, 780 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:09:56,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:56,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451775 s, 22.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:09:56,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:09:56,626::task::595::TaskManager.Task::(_updateState) Task=`76c55c28-b65e-4c79-896f-d92c565b6b51`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:56,626::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:09:56,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:56,647::task::1185::TaskManager.Task::(prepare) Task=`76c55c28-b65e-4c79-896f-d92c565b6b51`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:09:56,647::task::595::TaskManager.Task::(_updateState) Task=`76c55c28-b65e-4c79-896f-d92c565b6b51`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:56,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:56,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:56,648::task::990::TaskManager.Task::(_decref) Task=`76c55c28-b65e-4c79-896f-d92c565b6b51`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:09:56,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:09:56,655::task::595::TaskManager.Task::(_updateState) Task=`601223d8-8559-42ca-8464-ab087b48efd3`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:09:56,655::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:09:56,656::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6b7a5bf0-e11f-45cc-8bba-1553a754772d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:09:56,656::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:09:56,657::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:09:56,657::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6b7a5bf0-e11f-45cc-8bba-1553a754772d`::Granted request >Thread-236::DEBUG::2014-03-30 11:09:56,657::task::827::TaskManager.Task::(resourceAcquired) Task=`601223d8-8559-42ca-8464-ab087b48efd3`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:09:56,658::task::990::TaskManager.Task::(_decref) Task=`601223d8-8559-42ca-8464-ab087b48efd3`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:09:56,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878477824', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:56,659::task::1185::TaskManager.Task::(prepare) Task=`601223d8-8559-42ca-8464-ab087b48efd3`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878477824', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:09:56,659::task::595::TaskManager.Task::(_updateState) Task=`601223d8-8559-42ca-8464-ab087b48efd3`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:09:56,659::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:09:56,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:09:56,660::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:09:56,660::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:09:56,660::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:09:56,660::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:09:56,661::task::990::TaskManager.Task::(_decref) Task=`601223d8-8559-42ca-8464-ab087b48efd3`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:09:57,273::task::595::TaskManager.Task::(_updateState) Task=`2676b533-0e74-44ba-8bf3-a33ad71ca834`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:09:57,274::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:09:57,274::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00492323', 'lastCheck': '3.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000443463', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:57,274::task::1185::TaskManager.Task::(prepare) Task=`2676b533-0e74-44ba-8bf3-a33ad71ca834`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00492323', 'lastCheck': '3.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000443463', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:09:57,274::task::595::TaskManager.Task::(_updateState) Task=`2676b533-0e74-44ba-8bf3-a33ad71ca834`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:09:57,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:09:57,275::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:09:57,275::task::990::TaskManager.Task::(_decref) Task=`2676b533-0e74-44ba-8bf3-a33ad71ca834`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:09:58,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:09:58,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455414 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:09:58,848::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:00,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:00,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037366 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:01,862::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:02,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:02,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451369 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:10:03,813::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:10:03,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00623752 s, 657 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:04,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:04,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449508 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:04,877::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:10:05,898::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:10:05,911::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000449521 s, 770 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:06,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:10:06,691::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:10:06,693::task::595::TaskManager.Task::(_updateState) Task=`dad7085f-5613-4291-be10-389056a740be`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:06,693::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:10:06,721::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:06,723::task::1185::TaskManager.Task::(prepare) Task=`dad7085f-5613-4291-be10-389056a740be`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:06,724::task::595::TaskManager.Task::(_updateState) Task=`dad7085f-5613-4291-be10-389056a740be`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:06,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:06,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:06,727::task::990::TaskManager.Task::(_decref) Task=`dad7085f-5613-4291-be10-389056a740be`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:10:06,739::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:10:06,743::task::595::TaskManager.Task::(_updateState) Task=`9953aa2f-4504-4435-9514-b739bc23d069`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:10:06,746::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:10:06,751::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e4cce189-f995-41e8-8330-5cc4a6459c0b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:10:06,753::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:10:06,756::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:10:06,758::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`e4cce189-f995-41e8-8330-5cc4a6459c0b`::Granted request >Thread-236::DEBUG::2014-03-30 11:10:06,763::task::827::TaskManager.Task::(resourceAcquired) Task=`9953aa2f-4504-4435-9514-b739bc23d069`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:10:06,765::task::990::TaskManager.Task::(_decref) Task=`9953aa2f-4504-4435-9514-b739bc23d069`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:10:06,777::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877199872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:06,779::task::1185::TaskManager.Task::(prepare) Task=`9953aa2f-4504-4435-9514-b739bc23d069`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877199872', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:06,781::task::595::TaskManager.Task::(_updateState) Task=`9953aa2f-4504-4435-9514-b739bc23d069`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:10:06,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:10:06,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:10:06,789::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:10:06,792::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:10:06,793::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:10:06,795::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:10:06,799::task::990::TaskManager.Task::(_decref) Task=`9953aa2f-4504-4435-9514-b739bc23d069`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:10:06,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425873 s, 24.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:07,890::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:08,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:08,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460752 s, 22.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:10,902::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:10,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:11,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374055 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:12,428::task::595::TaskManager.Task::(_updateState) Task=`2e2bef68-ed96-4472-b6d3-88f52836adbd`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:12,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:10:12,429::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00623752', 'lastCheck': '8.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449521', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:12,429::task::1185::TaskManager.Task::(prepare) Task=`2e2bef68-ed96-4472-b6d3-88f52836adbd`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00623752', 'lastCheck': '8.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449521', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:12,429::task::595::TaskManager.Task::(_updateState) Task=`2e2bef68-ed96-4472-b6d3-88f52836adbd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:12,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:12,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:12,430::task::990::TaskManager.Task::(_decref) Task=`2e2bef68-ed96-4472-b6d3-88f52836adbd`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:10:13,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:13,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450462 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:10:13,844::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:10:13,862::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00530315 s, 772 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:13,914::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:15,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:15,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03718 s, 27.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:10:15,922::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:10:15,934::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00044576 s, 776 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:16,835::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:10:16,835::task::595::TaskManager.Task::(_updateState) Task=`b1316229-f74e-4193-9cd1-14b3475d8268`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:16,836::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:10:16,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:16,861::task::1185::TaskManager.Task::(prepare) Task=`b1316229-f74e-4193-9cd1-14b3475d8268`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:16,861::task::595::TaskManager.Task::(_updateState) Task=`b1316229-f74e-4193-9cd1-14b3475d8268`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:16,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:16,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:16,862::task::990::TaskManager.Task::(_decref) Task=`b1316229-f74e-4193-9cd1-14b3475d8268`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:10:16,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:10:16,870::task::595::TaskManager.Task::(_updateState) Task=`dc516c6d-fc89-4969-8b96-297cee1a8181`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:10:16,870::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:10:16,871::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`4479e084-57d6-4e80-9657-0ce02b3dc508`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:10:16,871::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:10:16,871::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:10:16,871::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`4479e084-57d6-4e80-9657-0ce02b3dc508`::Granted request >Thread-236::DEBUG::2014-03-30 11:10:16,872::task::827::TaskManager.Task::(resourceAcquired) Task=`dc516c6d-fc89-4969-8b96-297cee1a8181`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:10:16,872::task::990::TaskManager.Task::(_decref) Task=`dc516c6d-fc89-4969-8b96-297cee1a8181`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:10:16,873::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:16,873::task::1185::TaskManager.Task::(prepare) Task=`dc516c6d-fc89-4969-8b96-297cee1a8181`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:16,874::task::595::TaskManager.Task::(_updateState) Task=`dc516c6d-fc89-4969-8b96-297cee1a8181`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:10:16,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:10:16,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:10:16,874::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:10:16,875::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:10:16,875::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:10:16,875::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:10:16,875::task::990::TaskManager.Task::(_decref) Task=`dc516c6d-fc89-4969-8b96-297cee1a8181`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:10:16,927::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:17,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:17,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457043 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:19,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:19,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373205 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:19,940::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:21,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:21,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370576 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:22,951::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:23,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:23,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450954 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:10:23,871::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:10:23,889::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00546972 s, 749 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:25,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:25,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372784 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:25,964::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:10:26,026::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:10:26,057::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000458799 s, 754 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:26,905::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [379768e1] >Thread-13::DEBUG::2014-03-30 11:10:26,905::task::595::TaskManager.Task::(_updateState) Task=`733e3e7e-b1a7-42b0-880b-b81f44ba927b`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:26,906::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:10:26,926::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:26,927::task::1185::TaskManager.Task::(prepare) Task=`733e3e7e-b1a7-42b0-880b-b81f44ba927b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:26,927::task::595::TaskManager.Task::(_updateState) Task=`733e3e7e-b1a7-42b0-880b-b81f44ba927b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:26,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:26,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:26,927::task::990::TaskManager.Task::(_decref) Task=`733e3e7e-b1a7-42b0-880b-b81f44ba927b`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:10:26,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [379768e1] >Thread-236::DEBUG::2014-03-30 11:10:26,934::task::595::TaskManager.Task::(_updateState) Task=`5784d4d8-f1ed-4b09-b1c8-6c941f2e0bfc`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:10:26,934::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:10:26,935::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`edc9ea4d-f90c-44d6-a055-6119833365ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:10:26,935::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:10:26,935::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:10:26,935::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`edc9ea4d-f90c-44d6-a055-6119833365ec`::Granted request >Thread-236::DEBUG::2014-03-30 11:10:26,936::task::827::TaskManager.Task::(resourceAcquired) Task=`5784d4d8-f1ed-4b09-b1c8-6c941f2e0bfc`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:10:26,936::task::990::TaskManager.Task::(_decref) Task=`5784d4d8-f1ed-4b09-b1c8-6c941f2e0bfc`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:10:26,937::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:26,937::task::1185::TaskManager.Task::(prepare) Task=`5784d4d8-f1ed-4b09-b1c8-6c941f2e0bfc`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:26,937::task::595::TaskManager.Task::(_updateState) Task=`5784d4d8-f1ed-4b09-b1c8-6c941f2e0bfc`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:10:26,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:10:26,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:10:26,938::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:10:26,938::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:10:26,939::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:10:26,939::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:10:26,939::task::990::TaskManager.Task::(_decref) Task=`5784d4d8-f1ed-4b09-b1c8-6c941f2e0bfc`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:10:27,615::task::595::TaskManager.Task::(_updateState) Task=`4ca456b2-795a-4894-a3fe-f2597753cee5`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:27,616::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:10:27,616::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00546972', 'lastCheck': '3.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458799', 'lastCheck': '1.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:27,616::task::1185::TaskManager.Task::(prepare) Task=`4ca456b2-795a-4894-a3fe-f2597753cee5`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00546972', 'lastCheck': '3.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000458799', 'lastCheck': '1.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:27,616::task::595::TaskManager.Task::(_updateState) Task=`4ca456b2-795a-4894-a3fe-f2597753cee5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:27,616::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:27,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:27,617::task::990::TaskManager.Task::(_decref) Task=`4ca456b2-795a-4894-a3fe-f2597753cee5`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:10:28,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:28,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450503 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:28,974::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:30,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:30,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403332 s, 25.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:31,986::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:32,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:32,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455306 s, 22.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:10:33,897::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:10:33,915::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00595235 s, 688 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:34,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:34,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455687 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:34,999::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:10:36,075::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:10:36,087::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000446062 s, 776 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:36,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:36,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045306 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:36,967::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:10:36,968::task::595::TaskManager.Task::(_updateState) Task=`e8f12715-7199-4568-a5c7-5c8d5dde60d8`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:36,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:10:36,994::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:36,994::task::1185::TaskManager.Task::(prepare) Task=`e8f12715-7199-4568-a5c7-5c8d5dde60d8`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:36,994::task::595::TaskManager.Task::(_updateState) Task=`e8f12715-7199-4568-a5c7-5c8d5dde60d8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:36,995::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:36,995::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:36,995::task::990::TaskManager.Task::(_decref) Task=`e8f12715-7199-4568-a5c7-5c8d5dde60d8`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:10:37,003::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:10:37,004::task::595::TaskManager.Task::(_updateState) Task=`c09c06bf-d64c-47c3-8b4a-30da69f95575`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:10:37,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:10:37,004::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`af64598d-b649-4922-b73e-ade051f0646a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:10:37,005::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:10:37,005::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:10:37,005::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`af64598d-b649-4922-b73e-ade051f0646a`::Granted request >Thread-236::DEBUG::2014-03-30 11:10:37,006::task::827::TaskManager.Task::(resourceAcquired) Task=`c09c06bf-d64c-47c3-8b4a-30da69f95575`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:10:37,006::task::990::TaskManager.Task::(_decref) Task=`c09c06bf-d64c-47c3-8b4a-30da69f95575`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:10:37,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:37,007::task::1185::TaskManager.Task::(prepare) Task=`c09c06bf-d64c-47c3-8b4a-30da69f95575`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:37,007::task::595::TaskManager.Task::(_updateState) Task=`c09c06bf-d64c-47c3-8b4a-30da69f95575`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:10:37,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:10:37,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:10:37,008::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:10:37,008::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:10:37,009::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:10:37,009::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:10:37,009::task::990::TaskManager.Task::(_decref) Task=`c09c06bf-d64c-47c3-8b4a-30da69f95575`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:10:38,013::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:38,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:38,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451263 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:40,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:10:41,025::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:41,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373292 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:42,807::task::595::TaskManager.Task::(_updateState) Task=`becf56f6-9404-4e02-859f-3b1f5635b3d8`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:42,808::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:10:42,808::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00595235', 'lastCheck': '8.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000446062', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:42,808::task::1185::TaskManager.Task::(prepare) Task=`becf56f6-9404-4e02-859f-3b1f5635b3d8`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00595235', 'lastCheck': '8.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000446062', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:42,808::task::595::TaskManager.Task::(_updateState) Task=`becf56f6-9404-4e02-859f-3b1f5635b3d8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:42,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:42,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:42,809::task::990::TaskManager.Task::(_decref) Task=`becf56f6-9404-4e02-859f-3b1f5635b3d8`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:10:43,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:43,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457706 s, 22.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:10:43,924::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:10:43,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00539358 s, 759 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:44,038::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:45,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:45,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038834 s, 26.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:10:46,109::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:10:46,124::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000429922 s, 805 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:47,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:10:47,041::task::595::TaskManager.Task::(_updateState) Task=`0fecbc94-5f7f-4e20-adc1-80b99e6be132`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:47,041::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >BindingXMLRPC::ERROR::2014-03-30 11:10:47,051::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::INFO::2014-03-30 11:10:47,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:47,077::task::1185::TaskManager.Task::(prepare) Task=`0fecbc94-5f7f-4e20-adc1-80b99e6be132`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:47,077::task::595::TaskManager.Task::(_updateState) Task=`0fecbc94-5f7f-4e20-adc1-80b99e6be132`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:47,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:47,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:47,077::task::990::TaskManager.Task::(_decref) Task=`0fecbc94-5f7f-4e20-adc1-80b99e6be132`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:10:47,087::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:10:47,088::task::595::TaskManager.Task::(_updateState) Task=`8ff78e0e-bd4d-49f4-a969-eba6641b5aaa`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:10:47,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:10:47,089::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b99f5111-5426-4eaa-94a7-13ebb5057790`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:10:47,089::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:10:47,089::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:10:47,089::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b99f5111-5426-4eaa-94a7-13ebb5057790`::Granted request >Thread-236::DEBUG::2014-03-30 11:10:47,090::task::827::TaskManager.Task::(resourceAcquired) Task=`8ff78e0e-bd4d-49f4-a969-eba6641b5aaa`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:10:47,090::task::990::TaskManager.Task::(_decref) Task=`8ff78e0e-bd4d-49f4-a969-eba6641b5aaa`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:10:47,091::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:47,091::task::1185::TaskManager.Task::(prepare) Task=`8ff78e0e-bd4d-49f4-a969-eba6641b5aaa`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:47,092::task::595::TaskManager.Task::(_updateState) Task=`8ff78e0e-bd4d-49f4-a969-eba6641b5aaa`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:10:47,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:10:47,092::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:10:47,092::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:10:47,093::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:10:47,093::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:10:47,093::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:10:47,093::task::990::TaskManager.Task::(_decref) Task=`8ff78e0e-bd4d-49f4-a969-eba6641b5aaa`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:10:47,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:47,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450816 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:49,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:49,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045121 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:50,063::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:51,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:51,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372155 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:53,075::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:10:53,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:53,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450877 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:10:53,951::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:10:53,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00538941 s, 760 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:10:55,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:10:55,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372955 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:56,086::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:10:56,126::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114 >Thread-15::DEBUG::2014-03-30 11:10:56,132::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114 >Thread-15::DEBUG::2014-03-30 11:10:56,133::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-15::DEBUG::2014-03-30 11:10:56,139::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=Export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', 'REMOTE_PATH=10.35.160.108:/RHEV/kuk', 'ROLE=Regular', 'SDUUID=3ffbee88-0d84-4a95-bba0-e8c2b2cfc114', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=395010f55dbb653af315d0ae088b6cc18568bd44'] >Thread-15::DEBUG::2014-03-30 11:10:56,140::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-15::INFO::2014-03-30 11:10:56,141::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114_imageNS already registered >Thread-15::INFO::2014-03-30 11:10:56,141::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114_volumeNS already registered >Thread-15::DEBUG::2014-03-30 11:10:56,149::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:10:56,161::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00043965 s, 787 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:10:57,118::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-13::DEBUG::2014-03-30 11:10:57,118::task::595::TaskManager.Task::(_updateState) Task=`f59fdfcf-97f4-48ae-8bad-20f83eb06ee2`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:10:57,119::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:10:57,143::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:57,143::task::1185::TaskManager.Task::(prepare) Task=`f59fdfcf-97f4-48ae-8bad-20f83eb06ee2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:10:57,143::task::595::TaskManager.Task::(_updateState) Task=`f59fdfcf-97f4-48ae-8bad-20f83eb06ee2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:57,143::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:57,143::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:57,143::task::990::TaskManager.Task::(_decref) Task=`f59fdfcf-97f4-48ae-8bad-20f83eb06ee2`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:10:57,149::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-236::DEBUG::2014-03-30 11:10:57,149::task::595::TaskManager.Task::(_updateState) Task=`4ff10f49-045a-4088-a99f-a09295fdffc1`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:10:57,149::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:10:57,150::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`d2f19d5d-62ec-4ace-a400-5f54a80f8805`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:10:57,150::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:10:57,150::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:10:57,150::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`d2f19d5d-62ec-4ace-a400-5f54a80f8805`::Granted request >Thread-236::DEBUG::2014-03-30 11:10:57,151::task::827::TaskManager.Task::(resourceAcquired) Task=`4ff10f49-045a-4088-a99f-a09295fdffc1`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:10:57,151::task::990::TaskManager.Task::(_decref) Task=`4ff10f49-045a-4088-a99f-a09295fdffc1`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:10:57,152::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:57,152::task::1185::TaskManager.Task::(prepare) Task=`4ff10f49-045a-4088-a99f-a09295fdffc1`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003877167104', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:10:57,152::task::595::TaskManager.Task::(_updateState) Task=`4ff10f49-045a-4088-a99f-a09295fdffc1`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:10:57,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:10:57,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:10:57,153::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:10:57,153::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:10:57,153::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:10:57,153::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:10:57,154::task::990::TaskManager.Task::(_decref) Task=`4ff10f49-045a-4088-a99f-a09295fdffc1`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:10:57,965::task::595::TaskManager.Task::(_updateState) Task=`6644305a-c3b4-4504-9359-056baccc0195`::moving from state init -> state preparing >Dummy-36::DEBUG::2014-03-30 11:10:57,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::INFO::2014-03-30 11:10:57,966::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:10:57,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538941', 'lastCheck': '4.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043965', 'lastCheck': '1.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:57,977::task::1185::TaskManager.Task::(prepare) Task=`6644305a-c3b4-4504-9359-056baccc0195`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538941', 'lastCheck': '4.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00043965', 'lastCheck': '1.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:10:57,978::task::595::TaskManager.Task::(_updateState) Task=`6644305a-c3b4-4504-9359-056baccc0195`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:10:57,978::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:10:57,978::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:10:57,979::task::990::TaskManager.Task::(_decref) Task=`6644305a-c3b4-4504-9359-056baccc0195`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:10:58,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391366 s, 26.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:10:59,097::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:00,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:00,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388638 s, 26.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:02,108::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:02,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:02,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451375 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:11:03,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:04,005::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00134359 s, 3.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:04,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:04,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451976 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:05,119::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:11:06,171::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:11:06,184::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000436953 s, 792 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:06,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:06,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451448 s, 22.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:07,176::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [431e32ae] >Thread-13::DEBUG::2014-03-30 11:11:07,177::task::595::TaskManager.Task::(_updateState) Task=`38960a28-b49c-4bb8-9400-35bc69803efd`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:07,177::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:11:07,204::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:07,204::task::1185::TaskManager.Task::(prepare) Task=`38960a28-b49c-4bb8-9400-35bc69803efd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:07,205::task::595::TaskManager.Task::(_updateState) Task=`38960a28-b49c-4bb8-9400-35bc69803efd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:07,205::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:07,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:07,205::task::990::TaskManager.Task::(_decref) Task=`38960a28-b49c-4bb8-9400-35bc69803efd`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:11:07,211::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [431e32ae] >Thread-236::DEBUG::2014-03-30 11:11:07,211::task::595::TaskManager.Task::(_updateState) Task=`6e3ae924-ae41-4e78-8c86-9876cacf2cc4`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:11:07,212::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:11:07,212::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`dc586978-3108-4ae5-a02d-21da1e10c47e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:11:07,212::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:11:07,213::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:11:07,213::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`dc586978-3108-4ae5-a02d-21da1e10c47e`::Granted request >Thread-236::DEBUG::2014-03-30 11:11:07,213::task::827::TaskManager.Task::(resourceAcquired) Task=`6e3ae924-ae41-4e78-8c86-9876cacf2cc4`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:11:07,214::task::990::TaskManager.Task::(_decref) Task=`6e3ae924-ae41-4e78-8c86-9876cacf2cc4`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:11:07,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003846823936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:07,215::task::1185::TaskManager.Task::(prepare) Task=`6e3ae924-ae41-4e78-8c86-9876cacf2cc4`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003846823936', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:07,215::task::595::TaskManager.Task::(_updateState) Task=`6e3ae924-ae41-4e78-8c86-9876cacf2cc4`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:11:07,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:11:07,216::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:11:07,216::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:11:07,216::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:11:07,216::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:11:07,216::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:11:07,217::task::990::TaskManager.Task::(_decref) Task=`6e3ae924-ae41-4e78-8c86-9876cacf2cc4`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:11:08,131::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:08,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:08,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453089 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:10,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:10,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037424 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:11,144::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:12,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:12,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375258 s, 27.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:13,136::task::595::TaskManager.Task::(_updateState) Task=`50545a05-cf32-4477-9c7f-7cf6d4feeb56`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:13,137::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:11:13,137::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134359', 'lastCheck': '9.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436953', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:13,137::task::1185::TaskManager.Task::(prepare) Task=`50545a05-cf32-4477-9c7f-7cf6d4feeb56`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134359', 'lastCheck': '9.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436953', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:13,137::task::595::TaskManager.Task::(_updateState) Task=`50545a05-cf32-4477-9c7f-7cf6d4feeb56`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:13,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:13,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:13,138::task::990::TaskManager.Task::(_decref) Task=`50545a05-cf32-4477-9c7f-7cf6d4feeb56`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:11:14,021::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:14,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00838447 s, 489 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:14,156::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:14,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:15,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452535 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:11:16,193::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:11:16,205::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000441869 s, 783 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:17,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:17,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465082 s, 22.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:17,169::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:11:17,242::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:11:17,243::task::595::TaskManager.Task::(_updateState) Task=`36e028b5-0018-4e32-b6c8-4694f04fc223`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:17,243::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:11:17,268::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:17,269::task::1185::TaskManager.Task::(prepare) Task=`36e028b5-0018-4e32-b6c8-4694f04fc223`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:17,269::task::595::TaskManager.Task::(_updateState) Task=`36e028b5-0018-4e32-b6c8-4694f04fc223`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:17,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:17,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:17,269::task::990::TaskManager.Task::(_decref) Task=`36e028b5-0018-4e32-b6c8-4694f04fc223`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:11:17,276::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:11:17,277::task::595::TaskManager.Task::(_updateState) Task=`02eff9fa-bd50-45c5-a02c-f79af610bc09`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:11:17,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:11:17,278::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ef2a930e-52b5-4b7c-bc32-68b6eb9b603b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:11:17,278::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:11:17,278::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:11:17,279::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ef2a930e-52b5-4b7c-bc32-68b6eb9b603b`::Granted request >Thread-236::DEBUG::2014-03-30 11:11:17,279::task::827::TaskManager.Task::(resourceAcquired) Task=`02eff9fa-bd50-45c5-a02c-f79af610bc09`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:11:17,279::task::990::TaskManager.Task::(_decref) Task=`02eff9fa-bd50-45c5-a02c-f79af610bc09`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:11:17,280::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003565838336', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:17,281::task::1185::TaskManager.Task::(prepare) Task=`02eff9fa-bd50-45c5-a02c-f79af610bc09`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003565838336', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:17,281::task::595::TaskManager.Task::(_updateState) Task=`02eff9fa-bd50-45c5-a02c-f79af610bc09`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:11:17,281::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:11:17,281::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:11:17,281::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:11:17,282::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:11:17,282::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:11:17,282::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:11:17,282::task::990::TaskManager.Task::(_decref) Task=`02eff9fa-bd50-45c5-a02c-f79af610bc09`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:11:19,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:19,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045698 s, 22.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:20,183::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:21,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:21,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374317 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:23,195::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:23,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:23,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480919 s, 21.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:11:24,055::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:24,077::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0088264 s, 464 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:25,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:25,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372121 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:26,206::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:11:26,217::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:11:26,229::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000368222 s, 940 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:27,313::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:11:27,314::task::595::TaskManager.Task::(_updateState) Task=`2402827f-6f52-498b-950a-10f0d1b26583`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:27,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:11:27,342::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:27,342::task::1185::TaskManager.Task::(prepare) Task=`2402827f-6f52-498b-950a-10f0d1b26583`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:27,343::task::595::TaskManager.Task::(_updateState) Task=`2402827f-6f52-498b-950a-10f0d1b26583`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:27,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:27,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:27,343::task::990::TaskManager.Task::(_decref) Task=`2402827f-6f52-498b-950a-10f0d1b26583`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:11:27,359::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:11:27,359::task::595::TaskManager.Task::(_updateState) Task=`6d821c14-4d7d-4f90-8e66-7a0d62437c00`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:11:27,359::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:11:27,360::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`5d2eaf74-afc7-4a82-bb0f-b32d8e2693f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:11:27,360::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:11:27,360::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:11:27,361::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`5d2eaf74-afc7-4a82-bb0f-b32d8e2693f5`::Granted request >Thread-236::DEBUG::2014-03-30 11:11:27,361::task::827::TaskManager.Task::(resourceAcquired) Task=`6d821c14-4d7d-4f90-8e66-7a0d62437c00`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:11:27,361::task::990::TaskManager.Task::(_decref) Task=`6d821c14-4d7d-4f90-8e66-7a0d62437c00`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:11:27,362::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878346752', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:27,362::task::1185::TaskManager.Task::(prepare) Task=`6d821c14-4d7d-4f90-8e66-7a0d62437c00`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878346752', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:27,363::task::595::TaskManager.Task::(_updateState) Task=`6d821c14-4d7d-4f90-8e66-7a0d62437c00`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:11:27,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:11:27,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:11:27,363::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:11:27,363::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:11:27,363::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:11:27,364::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:11:27,364::task::990::TaskManager.Task::(_decref) Task=`6d821c14-4d7d-4f90-8e66-7a0d62437c00`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:11:27,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:27,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380694 s, 26.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:28,336::task::595::TaskManager.Task::(_updateState) Task=`8a0a432c-d57c-48f6-ba3d-65a892beeb88`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:28,340::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:11:28,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0088264', 'lastCheck': '4.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368222', 'lastCheck': '2.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:28,341::task::1185::TaskManager.Task::(prepare) Task=`8a0a432c-d57c-48f6-ba3d-65a892beeb88`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0088264', 'lastCheck': '4.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368222', 'lastCheck': '2.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:28,341::task::595::TaskManager.Task::(_updateState) Task=`8a0a432c-d57c-48f6-ba3d-65a892beeb88`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:28,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:28,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:28,342::task::990::TaskManager.Task::(_decref) Task=`8a0a432c-d57c-48f6-ba3d-65a892beeb88`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:11:29,220::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:29,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:29,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453662 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:31,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:32,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370849 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:32,231::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:34,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:34,105::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:34,158::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000556877 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:34,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150227 s, 6.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:35,243::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:11:36,239::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:11:36,258::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000372999 s, 928 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:36,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:36,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454946 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:37,390::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:11:37,391::task::595::TaskManager.Task::(_updateState) Task=`593c52fd-5667-4915-a228-8c457c7fcb5e`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:37,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:11:37,413::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:37,414::task::1185::TaskManager.Task::(prepare) Task=`593c52fd-5667-4915-a228-8c457c7fcb5e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:37,414::task::595::TaskManager.Task::(_updateState) Task=`593c52fd-5667-4915-a228-8c457c7fcb5e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:37,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:37,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:37,415::task::990::TaskManager.Task::(_decref) Task=`593c52fd-5667-4915-a228-8c457c7fcb5e`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:11:37,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:11:37,422::task::595::TaskManager.Task::(_updateState) Task=`2d0fecf6-329e-42d0-9efb-5db1efacb969`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:11:37,423::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:11:37,423::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`271d4e0c-fede-4d21-95d4-82d5cda06781`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:11:37,424::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:11:37,424::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:11:37,424::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`271d4e0c-fede-4d21-95d4-82d5cda06781`::Granted request >Thread-236::DEBUG::2014-03-30 11:11:37,425::task::827::TaskManager.Task::(resourceAcquired) Task=`2d0fecf6-329e-42d0-9efb-5db1efacb969`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:11:37,425::task::990::TaskManager.Task::(_decref) Task=`2d0fecf6-329e-42d0-9efb-5db1efacb969`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:11:37,426::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:37,426::task::1185::TaskManager.Task::(prepare) Task=`2d0fecf6-329e-42d0-9efb-5db1efacb969`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:37,426::task::595::TaskManager.Task::(_updateState) Task=`2d0fecf6-329e-42d0-9efb-5db1efacb969`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:11:37,427::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:11:37,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:11:37,427::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:11:37,427::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:11:37,428::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:11:37,428::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:11:37,428::task::990::TaskManager.Task::(_decref) Task=`2d0fecf6-329e-42d0-9efb-5db1efacb969`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:11:38,255::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:38,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:38,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452084 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:40,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:40,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381695 s, 26.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:41,266::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:42,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:42,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378936 s, 27.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:43,512::task::595::TaskManager.Task::(_updateState) Task=`00d1ec8c-7083-4346-8ca4-35a89b55d984`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:43,513::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:11:43,513::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556877', 'lastCheck': '9.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372999', 'lastCheck': '7.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:43,513::task::1185::TaskManager.Task::(prepare) Task=`00d1ec8c-7083-4346-8ca4-35a89b55d984`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000556877', 'lastCheck': '9.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372999', 'lastCheck': '7.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:43,514::task::595::TaskManager.Task::(_updateState) Task=`00d1ec8c-7083-4346-8ca4-35a89b55d984`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:43,514::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:43,514::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:43,514::task::990::TaskManager.Task::(_decref) Task=`00d1ec8c-7083-4346-8ca4-35a89b55d984`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:11:44,211::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:44,234::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00985664 s, 416 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:44,278::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:44,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:44,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451039 s, 22.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:11:46,269::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:11:46,281::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000453135 s, 764 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:46,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:46,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449977 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:47,292::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:11:47,453::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:11:47,454::task::595::TaskManager.Task::(_updateState) Task=`eaa3ced5-9d71-4f8b-a95b-c74f21190c82`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:47,454::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:11:47,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:47,497::task::1185::TaskManager.Task::(prepare) Task=`eaa3ced5-9d71-4f8b-a95b-c74f21190c82`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:47,497::task::595::TaskManager.Task::(_updateState) Task=`eaa3ced5-9d71-4f8b-a95b-c74f21190c82`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:47,498::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:47,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:47,498::task::990::TaskManager.Task::(_decref) Task=`eaa3ced5-9d71-4f8b-a95b-c74f21190c82`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:11:47,505::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:11:47,506::task::595::TaskManager.Task::(_updateState) Task=`b4256885-042c-4676-a283-2d032852f898`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:11:47,506::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:11:47,510::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`87faf4f0-aeae-4520-9b18-77fc8bf91936`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:11:47,511::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:11:47,513::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:11:47,514::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`87faf4f0-aeae-4520-9b18-77fc8bf91936`::Granted request >Thread-236::DEBUG::2014-03-30 11:11:47,516::task::827::TaskManager.Task::(resourceAcquired) Task=`b4256885-042c-4676-a283-2d032852f898`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:11:47,517::task::990::TaskManager.Task::(_decref) Task=`b4256885-042c-4676-a283-2d032852f898`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:11:47,522::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:47,524::task::1185::TaskManager.Task::(prepare) Task=`b4256885-042c-4676-a283-2d032852f898`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:47,526::task::595::TaskManager.Task::(_updateState) Task=`b4256885-042c-4676-a283-2d032852f898`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:11:47,527::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:11:47,529::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:11:47,531::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:11:47,531::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:11:47,531::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:11:47,532::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:11:47,533::task::990::TaskManager.Task::(_decref) Task=`b4256885-042c-4676-a283-2d032852f898`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:11:49,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:49,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454165 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:50,305::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:51,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:51,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401216 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:53,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:11:53,317::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:53,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497158 s, 20.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:11:54,249::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:11:54,273::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000580566 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:11:55,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:55,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.341105 s, 3.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:11:56,292::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:11:56,304::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000448371 s, 772 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:11:56,331::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:11:57,561::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:11:57,563::task::595::TaskManager.Task::(_updateState) Task=`e5f7086c-e155-472d-afb1-d3638566ccfd`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:57,563::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:11:57,582::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:57,583::task::1185::TaskManager.Task::(prepare) Task=`e5f7086c-e155-472d-afb1-d3638566ccfd`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:11:57,583::task::595::TaskManager.Task::(_updateState) Task=`e5f7086c-e155-472d-afb1-d3638566ccfd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:57,583::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:57,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:57,583::task::990::TaskManager.Task::(_decref) Task=`e5f7086c-e155-472d-afb1-d3638566ccfd`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:11:57,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:11:57,589::task::595::TaskManager.Task::(_updateState) Task=`6335806b-0bd5-45b2-9bb5-be8abd63b5c6`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:11:57,589::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:11:57,590::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`49f97118-958a-4c15-9d4f-c3ab7643bedf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:11:57,590::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:11:57,590::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:11:57,590::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`49f97118-958a-4c15-9d4f-c3ab7643bedf`::Granted request >Thread-236::DEBUG::2014-03-30 11:11:57,591::task::827::TaskManager.Task::(resourceAcquired) Task=`6335806b-0bd5-45b2-9bb5-be8abd63b5c6`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:11:57,591::task::990::TaskManager.Task::(_decref) Task=`6335806b-0bd5-45b2-9bb5-be8abd63b5c6`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:11:57,592::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:57,592::task::1185::TaskManager.Task::(prepare) Task=`6335806b-0bd5-45b2-9bb5-be8abd63b5c6`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:11:57,592::task::595::TaskManager.Task::(_updateState) Task=`6335806b-0bd5-45b2-9bb5-be8abd63b5c6`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:11:57,592::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:11:57,592::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:11:57,593::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:11:57,593::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:11:57,593::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:11:57,593::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:11:57,593::task::990::TaskManager.Task::(_decref) Task=`6335806b-0bd5-45b2-9bb5-be8abd63b5c6`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:11:57,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:11:57,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372024 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:11:58,694::task::595::TaskManager.Task::(_updateState) Task=`5ed3275f-1506-44ff-aaee-ba3bd1af3bd6`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:11:58,694::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:11:58,694::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580566', 'lastCheck': '4.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448371', 'lastCheck': '2.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:58,694::task::1185::TaskManager.Task::(prepare) Task=`5ed3275f-1506-44ff-aaee-ba3bd1af3bd6`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000580566', 'lastCheck': '4.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000448371', 'lastCheck': '2.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:11:58,695::task::595::TaskManager.Task::(_updateState) Task=`5ed3275f-1506-44ff-aaee-ba3bd1af3bd6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:11:58,695::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:11:58,695::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:11:58,695::task::990::TaskManager.Task::(_decref) Task=`5ed3275f-1506-44ff-aaee-ba3bd1af3bd6`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:11:59,343::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:11:59,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:00,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045458 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:02,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:02,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419795 s, 24.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:02,358::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:04,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:04,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450539 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:12:04,314::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:12:04,335::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00611237 s, 670 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:05,373::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:12:06,314::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:12:06,326::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00044882 s, 771 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:06,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:06,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456974 s, 22.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:12:07,621::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:12:07,622::task::595::TaskManager.Task::(_updateState) Task=`9ad60910-6d61-413c-a22f-f08831e928f6`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:07,622::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:12:07,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:07,645::task::1185::TaskManager.Task::(prepare) Task=`9ad60910-6d61-413c-a22f-f08831e928f6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:07,646::task::595::TaskManager.Task::(_updateState) Task=`9ad60910-6d61-413c-a22f-f08831e928f6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:07,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:07,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:07,646::task::990::TaskManager.Task::(_decref) Task=`9ad60910-6d61-413c-a22f-f08831e928f6`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:12:07,653::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:12:07,653::task::595::TaskManager.Task::(_updateState) Task=`482f56d9-3855-447d-b714-112b9f1b6c71`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:12:07,653::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:12:07,654::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bdfef3e0-2710-41be-bb4c-36312140e997`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:12:07,654::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:12:07,655::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:12:07,655::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bdfef3e0-2710-41be-bb4c-36312140e997`::Granted request >Thread-236::DEBUG::2014-03-30 11:12:07,655::task::827::TaskManager.Task::(resourceAcquired) Task=`482f56d9-3855-447d-b714-112b9f1b6c71`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:12:07,655::task::990::TaskManager.Task::(_decref) Task=`482f56d9-3855-447d-b714-112b9f1b6c71`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:12:07,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:07,657::task::1185::TaskManager.Task::(prepare) Task=`482f56d9-3855-447d-b714-112b9f1b6c71`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003878379520', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:07,657::task::595::TaskManager.Task::(_updateState) Task=`482f56d9-3855-447d-b714-112b9f1b6c71`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:12:07,657::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:12:07,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:12:07,658::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:12:07,658::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:12:07,658::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:12:07,658::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:12:07,659::task::990::TaskManager.Task::(_decref) Task=`482f56d9-3855-447d-b714-112b9f1b6c71`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:12:08,385::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:08,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:08,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451967 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:10,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:10,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569286 s, 18.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:11,396::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:12,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:12,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407065 s, 25.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:12:13,872::task::595::TaskManager.Task::(_updateState) Task=`234e244d-e320-490c-88b9-cfc68ae37533`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:13,873::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:12:13,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00611237', 'lastCheck': '9.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00044882', 'lastCheck': '7.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:13,873::task::1185::TaskManager.Task::(prepare) Task=`234e244d-e320-490c-88b9-cfc68ae37533`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00611237', 'lastCheck': '9.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00044882', 'lastCheck': '7.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:13,873::task::595::TaskManager.Task::(_updateState) Task=`234e244d-e320-490c-88b9-cfc68ae37533`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:13,874::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:13,874::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:13,874::task::990::TaskManager.Task::(_decref) Task=`234e244d-e320-490c-88b9-cfc68ae37533`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:12:14,350::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:12:14,370::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00659589 s, 621 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:14,408::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:14,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:14,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452272 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:12:16,335::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:12:16,347::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000441427 s, 784 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:16,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:17,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551765 s, 18.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:17,420::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:12:17,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:12:17,685::task::595::TaskManager.Task::(_updateState) Task=`ba3de05e-40e3-42a6-80df-498a3c13c379`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:17,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:12:17,712::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:17,713::task::1185::TaskManager.Task::(prepare) Task=`ba3de05e-40e3-42a6-80df-498a3c13c379`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:17,713::task::595::TaskManager.Task::(_updateState) Task=`ba3de05e-40e3-42a6-80df-498a3c13c379`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:17,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:17,713::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:17,713::task::990::TaskManager.Task::(_decref) Task=`ba3de05e-40e3-42a6-80df-498a3c13c379`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:12:17,720::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:12:17,721::task::595::TaskManager.Task::(_updateState) Task=`7e513f7c-884a-4bbd-9038-3ce48208ea09`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:12:17,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:12:17,721::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`efa8be4e-8586-4f67-b706-ac1a5867abee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:12:17,722::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:12:17,722::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:12:17,722::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`efa8be4e-8586-4f67-b706-ac1a5867abee`::Granted request >Thread-236::DEBUG::2014-03-30 11:12:17,723::task::827::TaskManager.Task::(resourceAcquired) Task=`7e513f7c-884a-4bbd-9038-3ce48208ea09`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:12:17,723::task::990::TaskManager.Task::(_decref) Task=`7e513f7c-884a-4bbd-9038-3ce48208ea09`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:12:17,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003882704896', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:17,724::task::1185::TaskManager.Task::(prepare) Task=`7e513f7c-884a-4bbd-9038-3ce48208ea09`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003882704896', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:17,724::task::595::TaskManager.Task::(_updateState) Task=`7e513f7c-884a-4bbd-9038-3ce48208ea09`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:12:17,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:12:17,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:12:17,725::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:12:17,725::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:12:17,725::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:12:17,726::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:12:17,726::task::990::TaskManager.Task::(_decref) Task=`7e513f7c-884a-4bbd-9038-3ce48208ea09`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:12:19,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:19,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451995 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:20,431::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:21,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:21,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371152 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:23,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:23,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458532 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:23,445::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:12:24,378::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:12:24,400::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00955369 s, 429 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:25,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:25,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453139 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:12:26,360::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:12:26,372::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000306649 s, 1.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:26,456::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:27,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:27,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372159 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:12:27,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [39c9f4d9] >Thread-13::DEBUG::2014-03-30 11:12:27,753::task::595::TaskManager.Task::(_updateState) Task=`2e7e0c44-8414-4210-9182-231b8cf13b5f`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:27,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:12:27,778::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:27,778::task::1185::TaskManager.Task::(prepare) Task=`2e7e0c44-8414-4210-9182-231b8cf13b5f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:27,779::task::595::TaskManager.Task::(_updateState) Task=`2e7e0c44-8414-4210-9182-231b8cf13b5f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:27,779::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:27,779::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:27,779::task::990::TaskManager.Task::(_decref) Task=`2e7e0c44-8414-4210-9182-231b8cf13b5f`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:12:27,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [39c9f4d9] >Thread-236::DEBUG::2014-03-30 11:12:27,786::task::595::TaskManager.Task::(_updateState) Task=`b8e48c8b-cc21-4d97-bc4e-5fa87cd5ae7f`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:12:27,786::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:12:27,786::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9f94019f-4027-41dc-ab44-1d3f1d464eef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:12:27,787::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:12:27,787::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:12:27,787::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9f94019f-4027-41dc-ab44-1d3f1d464eef`::Granted request >Thread-236::DEBUG::2014-03-30 11:12:27,788::task::827::TaskManager.Task::(resourceAcquired) Task=`b8e48c8b-cc21-4d97-bc4e-5fa87cd5ae7f`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:12:27,788::task::990::TaskManager.Task::(_decref) Task=`b8e48c8b-cc21-4d97-bc4e-5fa87cd5ae7f`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:12:27,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003882704896', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:27,789::task::1185::TaskManager.Task::(prepare) Task=`b8e48c8b-cc21-4d97-bc4e-5fa87cd5ae7f`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003882704896', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:27,789::task::595::TaskManager.Task::(_updateState) Task=`b8e48c8b-cc21-4d97-bc4e-5fa87cd5ae7f`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:12:27,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:12:27,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:12:27,790::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:12:27,790::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:12:27,790::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:12:27,791::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:12:27,791::task::990::TaskManager.Task::(_decref) Task=`b8e48c8b-cc21-4d97-bc4e-5fa87cd5ae7f`::ref 0 aborting False >Thread-13::DEBUG::2014-03-30 11:12:29,327::task::595::TaskManager.Task::(_updateState) Task=`997b6c08-14d0-49d9-949a-72ad788b4bd6`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:29,331::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:12:29,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00955369', 'lastCheck': '4.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306649', 'lastCheck': '3.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:29,337::task::1185::TaskManager.Task::(prepare) Task=`997b6c08-14d0-49d9-949a-72ad788b4bd6`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00955369', 'lastCheck': '4.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000306649', 'lastCheck': '3.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:29,339::task::595::TaskManager.Task::(_updateState) Task=`997b6c08-14d0-49d9-949a-72ad788b4bd6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:29,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:29,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:29,346::task::990::TaskManager.Task::(_decref) Task=`997b6c08-14d0-49d9-949a-72ad788b4bd6`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:12:29,468::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:29,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:29,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454993 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:31,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:31,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461418 s, 22.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:32,480::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:33,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:34,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0540743 s, 18.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:12:34,409::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:12:34,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00494027 s, 829 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:35,491::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:36,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:36,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451201 s, 22.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:12:36,381::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:12:36,393::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000415125 s, 833 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:12:37,820::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:12:37,821::task::595::TaskManager.Task::(_updateState) Task=`10c743b6-bdf5-4e73-9a01-d1ca521c9b19`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:37,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:12:37,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:37,845::task::1185::TaskManager.Task::(prepare) Task=`10c743b6-bdf5-4e73-9a01-d1ca521c9b19`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:37,846::task::595::TaskManager.Task::(_updateState) Task=`10c743b6-bdf5-4e73-9a01-d1ca521c9b19`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:37,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:37,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:37,846::task::990::TaskManager.Task::(_decref) Task=`10c743b6-bdf5-4e73-9a01-d1ca521c9b19`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:12:37,853::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:12:37,853::task::595::TaskManager.Task::(_updateState) Task=`ec05f9f8-105e-43c8-8110-51cc3e070501`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:12:37,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:12:37,854::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ce3e70f9-5d6f-4ef1-926b-0884f0a156f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:12:37,854::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:12:37,855::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:12:37,855::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ce3e70f9-5d6f-4ef1-926b-0884f0a156f1`::Granted request >Thread-236::DEBUG::2014-03-30 11:12:37,855::task::827::TaskManager.Task::(resourceAcquired) Task=`ec05f9f8-105e-43c8-8110-51cc3e070501`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:12:37,856::task::990::TaskManager.Task::(_decref) Task=`ec05f9f8-105e-43c8-8110-51cc3e070501`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:12:37,857::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003882704896', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:37,857::task::1185::TaskManager.Task::(prepare) Task=`ec05f9f8-105e-43c8-8110-51cc3e070501`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2003882704896', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:37,857::task::595::TaskManager.Task::(_updateState) Task=`ec05f9f8-105e-43c8-8110-51cc3e070501`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:12:37,857::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:12:37,858::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:12:37,858::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:12:37,858::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:12:37,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:12:37,858::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:12:37,859::task::990::TaskManager.Task::(_decref) Task=`ec05f9f8-105e-43c8-8110-51cc3e070501`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:12:38,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:38,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460361 s, 22.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:38,504::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:40,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:40,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037427 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:41,517::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:42,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:42,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372321 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:12:44,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:12:44,454::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00535218 s, 765 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:44,529::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:12:44,543::task::595::TaskManager.Task::(_updateState) Task=`95836048-5319-420e-9e39-d7353aad14ed`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:44,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:12:44,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535218', 'lastCheck': '0.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415125', 'lastCheck': '8.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:44,544::task::1185::TaskManager.Task::(prepare) Task=`95836048-5319-420e-9e39-d7353aad14ed`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00535218', 'lastCheck': '0.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000415125', 'lastCheck': '8.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:44,544::task::595::TaskManager.Task::(_updateState) Task=`95836048-5319-420e-9e39-d7353aad14ed`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:44,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:44,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:44,545::task::990::TaskManager.Task::(_decref) Task=`95836048-5319-420e-9e39-d7353aad14ed`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:12:44,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:44,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489494 s, 20.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:12:46,402::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:12:46,414::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000456819 s, 757 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:46,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:46,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451633 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:47,542::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:12:47,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1aefd25] >Thread-13::DEBUG::2014-03-30 11:12:47,885::task::595::TaskManager.Task::(_updateState) Task=`2650780d-27fb-498d-bf48-969464140742`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:47,886::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:12:47,915::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:47,915::task::1185::TaskManager.Task::(prepare) Task=`2650780d-27fb-498d-bf48-969464140742`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:47,916::task::595::TaskManager.Task::(_updateState) Task=`2650780d-27fb-498d-bf48-969464140742`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:47,916::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:47,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:47,916::task::990::TaskManager.Task::(_decref) Task=`2650780d-27fb-498d-bf48-969464140742`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:12:47,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1aefd25] >Thread-236::DEBUG::2014-03-30 11:12:47,925::task::595::TaskManager.Task::(_updateState) Task=`9d1a7705-7e18-4b1f-aac2-a8ca473d68d7`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:12:47,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:12:47,926::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3f56158c-db95-4e99-a3c6-fe4223f9cec2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:12:47,926::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:12:47,926::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:12:47,927::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3f56158c-db95-4e99-a3c6-fe4223f9cec2`::Granted request >Thread-236::DEBUG::2014-03-30 11:12:47,927::task::827::TaskManager.Task::(resourceAcquired) Task=`9d1a7705-7e18-4b1f-aac2-a8ca473d68d7`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:12:47,927::task::990::TaskManager.Task::(_decref) Task=`9d1a7705-7e18-4b1f-aac2-a8ca473d68d7`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:12:47,928::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2005051244544', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:47,929::task::1185::TaskManager.Task::(prepare) Task=`9d1a7705-7e18-4b1f-aac2-a8ca473d68d7`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2005051244544', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:47,929::task::595::TaskManager.Task::(_updateState) Task=`9d1a7705-7e18-4b1f-aac2-a8ca473d68d7`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:12:47,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:12:47,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:12:47,929::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:12:47,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:12:47,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:12:47,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:12:47,930::task::990::TaskManager.Task::(_decref) Task=`9d1a7705-7e18-4b1f-aac2-a8ca473d68d7`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:12:48,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:48,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372265 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:50,554::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:50,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:51,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454477 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:53,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:53,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372213 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:53,567::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:12:54,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:12:54,481::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00616957 s, 664 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:12:55,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:55,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453339 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:12:56,424::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:12:56,436::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000425731 s, 813 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:12:56,578::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:57,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:12:57,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372748 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:12:57,959::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:12:57,959::task::595::TaskManager.Task::(_updateState) Task=`455564f1-4613-4004-861b-0389330da823`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:57,960::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:12:57,972::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:57,972::task::1185::TaskManager.Task::(prepare) Task=`455564f1-4613-4004-861b-0389330da823`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:12:57,972::task::595::TaskManager.Task::(_updateState) Task=`455564f1-4613-4004-861b-0389330da823`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:57,972::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:57,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:57,973::task::990::TaskManager.Task::(_decref) Task=`455564f1-4613-4004-861b-0389330da823`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:12:57,980::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:12:57,980::task::595::TaskManager.Task::(_updateState) Task=`73fbd4d0-69e5-4d13-ad76-df65346c03da`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:12:57,980::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:12:57,981::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`8f43462c-114a-4237-8e94-e085d9063ccd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:12:57,981::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:12:57,981::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:12:57,982::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`8f43462c-114a-4237-8e94-e085d9063ccd`::Granted request >Thread-236::DEBUG::2014-03-30 11:12:57,982::task::827::TaskManager.Task::(resourceAcquired) Task=`73fbd4d0-69e5-4d13-ad76-df65346c03da`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:12:57,982::task::990::TaskManager.Task::(_decref) Task=`73fbd4d0-69e5-4d13-ad76-df65346c03da`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:12:57,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013626793984', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:57,984::task::1185::TaskManager.Task::(prepare) Task=`73fbd4d0-69e5-4d13-ad76-df65346c03da`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013626793984', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:12:57,984::task::595::TaskManager.Task::(_updateState) Task=`73fbd4d0-69e5-4d13-ad76-df65346c03da`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:12:57,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:12:57,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:12:57,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:12:57,985::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:12:57,985::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:12:57,985::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:12:57,986::task::990::TaskManager.Task::(_decref) Task=`73fbd4d0-69e5-4d13-ad76-df65346c03da`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:12:59,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:12:59,593::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:12:59,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473327 s, 21.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:12:59,717::task::595::TaskManager.Task::(_updateState) Task=`2643e121-3f5d-492a-8f72-64ca9bd34cfa`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:12:59,721::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:12:59,726::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00616957', 'lastCheck': '5.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425731', 'lastCheck': '3.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:59,729::task::1185::TaskManager.Task::(prepare) Task=`2643e121-3f5d-492a-8f72-64ca9bd34cfa`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00616957', 'lastCheck': '5.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000425731', 'lastCheck': '3.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:12:59,732::task::595::TaskManager.Task::(_updateState) Task=`2643e121-3f5d-492a-8f72-64ca9bd34cfa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:12:59,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:12:59,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:12:59,743::task::990::TaskManager.Task::(_decref) Task=`2643e121-3f5d-492a-8f72-64ca9bd34cfa`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:01,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:02,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378288 s, 27.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:02,605::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:04,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:04,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370786 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:04,489::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:04,503::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000534143 s, 7.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:05,617::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:06,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:06,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370824 s, 27.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:13:06,447::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:13:06,458::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00047031 s, 736 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:13:08,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:13:08,013::task::595::TaskManager.Task::(_updateState) Task=`0c47e6d5-6fbf-4b33-8290-fd7cf58f82ee`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:08,013::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:13:08,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:08,037::task::1185::TaskManager.Task::(prepare) Task=`0c47e6d5-6fbf-4b33-8290-fd7cf58f82ee`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:08,037::task::595::TaskManager.Task::(_updateState) Task=`0c47e6d5-6fbf-4b33-8290-fd7cf58f82ee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:08,037::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:08,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:08,038::task::990::TaskManager.Task::(_decref) Task=`0c47e6d5-6fbf-4b33-8290-fd7cf58f82ee`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:13:08,043::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:13:08,043::task::595::TaskManager.Task::(_updateState) Task=`361f2640-7c9a-4671-b6f9-1e1da06f3bfa`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:13:08,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:13:08,044::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`69884ce4-a09e-45c1-ae4a-61a8b8b4e353`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:13:08,044::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:13:08,045::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:13:08,045::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`69884ce4-a09e-45c1-ae4a-61a8b8b4e353`::Granted request >Thread-236::DEBUG::2014-03-30 11:13:08,045::task::827::TaskManager.Task::(resourceAcquired) Task=`361f2640-7c9a-4671-b6f9-1e1da06f3bfa`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:13:08,045::task::990::TaskManager.Task::(_decref) Task=`361f2640-7c9a-4671-b6f9-1e1da06f3bfa`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:13:08,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013626793984', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:08,047::task::1185::TaskManager.Task::(prepare) Task=`361f2640-7c9a-4671-b6f9-1e1da06f3bfa`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013626793984', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:08,047::task::595::TaskManager.Task::(_updateState) Task=`361f2640-7c9a-4671-b6f9-1e1da06f3bfa`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:13:08,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:13:08,047::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:13:08,048::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:13:08,048::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:13:08,048::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:13:08,048::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:13:08,049::task::990::TaskManager.Task::(_decref) Task=`361f2640-7c9a-4671-b6f9-1e1da06f3bfa`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:08,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:08,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449813 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:08,629::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:10,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:10,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372628 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:11,641::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:12,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:12,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370349 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:14,508::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:13:14,508::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:13:14,508::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::DEBUG::2014-03-30 11:13:14,509::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:13:14,512::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:14,523::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000536889 s, 3.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:14,524::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000536889 s, 3.8 MB/s'], size: 2048 >Thread-14::DEBUG::2014-03-30 11:13:14,524::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-03-30 11:13:14,524::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-03-30 11:13:14,524::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:13:14,525::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:13:14,525::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:13:14,525::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:13:14,525::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:13:14,526::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:13:14,527::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000567e404977a4e311|/dev/mapper/360060160f4a03000da2233488fa4e311|/dev/mapper/360060160f4a03000e86588568fa4e311|/dev/mapper/360060160f4a03000f8d72cd38ca4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:13:14,653::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:14,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:14,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453494 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:14,859::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:14,861::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:13:14,861::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=wxY9cX-001T-eqwx-zf7D-Yhcl-2Uwh-KUR3m6', 'LOCKPOLICY=', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:360060160f4a03000da2233488fa4e311,uuid:Qj89Z4-DLwY-sR5F-gGtn-bLRy-SNKX-2ho7ew,pestart:0,pecount:557,mapoffset:0', 'LEASERETRIES=3', 'SDUUID=dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'CLASS=Data', 'DESCRIPTION=Imp_Exp_DC0_data_domain0', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Imp_Exp_DC0', 'ROLE=Master', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', u'POOL_DOMAINS=dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=2', '_SHA_CKSUM=db97a5e6891143b5e26a4bf2aacf0ba3b85f20a6'] >Thread-14::INFO::2014-03-30 11:13:14,862::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_imageNS already registered >Thread-14::INFO::2014-03-30 11:13:14,863::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_volumeNS already registered >Thread-14::INFO::2014-03-30 11:13:14,863::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_lvmActivationNS already registered >Thread-14::DEBUG::2014-03-30 11:13:14,863::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000da2233488fa4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Thread-13::DEBUG::2014-03-30 11:13:14,984::task::595::TaskManager.Task::(_updateState) Task=`bddad423-9b3e-4b67-b4eb-11fd610d8c03`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:14,984::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:13:14,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534143', 'lastCheck': '10.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047031', 'lastCheck': '8.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:13:14,985::task::1185::TaskManager.Task::(prepare) Task=`bddad423-9b3e-4b67-b4eb-11fd610d8c03`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000534143', 'lastCheck': '10.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00047031', 'lastCheck': '8.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:13:14,985::task::595::TaskManager.Task::(_updateState) Task=`bddad423-9b3e-4b67-b4eb-11fd610d8c03`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:14,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:14,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:14,986::task::990::TaskManager.Task::(_decref) Task=`bddad423-9b3e-4b67-b4eb-11fd610d8c03`::ref 0 aborting False >Thread-14::DEBUG::2014-03-30 11:13:15,030::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:15,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:15,048::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000537584 s, 7.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:13:16,467::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:13:16,479::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000432031 s, 801 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:16,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:16,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458518 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:17,667::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:13:18,073::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:13:18,074::task::595::TaskManager.Task::(_updateState) Task=`502689f1-6152-4394-8dc8-65dbeb422ea0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:18,074::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:13:18,103::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:18,104::task::1185::TaskManager.Task::(prepare) Task=`502689f1-6152-4394-8dc8-65dbeb422ea0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:18,104::task::595::TaskManager.Task::(_updateState) Task=`502689f1-6152-4394-8dc8-65dbeb422ea0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:18,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:18,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:18,104::task::990::TaskManager.Task::(_decref) Task=`502689f1-6152-4394-8dc8-65dbeb422ea0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:13:18,109::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:13:18,110::task::595::TaskManager.Task::(_updateState) Task=`477812f0-d5dd-4ec9-9255-680565414a64`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:13:18,110::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:13:18,111::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0b6be124-57fa-4079-8efc-d6c7466c6b3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:13:18,111::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:13:18,111::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:13:18,112::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0b6be124-57fa-4079-8efc-d6c7466c6b3c`::Granted request >Thread-236::DEBUG::2014-03-30 11:13:18,112::task::827::TaskManager.Task::(resourceAcquired) Task=`477812f0-d5dd-4ec9-9255-680565414a64`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:13:18,112::task::990::TaskManager.Task::(_decref) Task=`477812f0-d5dd-4ec9-9255-680565414a64`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:13:18,113::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013625516032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:18,114::task::1185::TaskManager.Task::(prepare) Task=`477812f0-d5dd-4ec9-9255-680565414a64`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013625516032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:18,114::task::595::TaskManager.Task::(_updateState) Task=`477812f0-d5dd-4ec9-9255-680565414a64`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:13:18,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:13:18,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:13:18,115::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:13:18,115::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:13:18,115::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:13:18,115::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:13:18,115::task::990::TaskManager.Task::(_decref) Task=`477812f0-d5dd-4ec9-9255-680565414a64`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:18,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:19,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377714 s, 27.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:20,682::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:21,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:21,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045688 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:23,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:23,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374834 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:23,694::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:13:25,059::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:25,076::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00429093 s, 955 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:25,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:25,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452724 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:13:26,492::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:13:26,504::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000396256 s, 873 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:26,709::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:27,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:27,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373575 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:13:28,138::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:13:28,138::task::595::TaskManager.Task::(_updateState) Task=`583b3a51-8ed2-4219-ad65-c1f7da6e888f`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:28,139::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:13:28,168::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:28,169::task::1185::TaskManager.Task::(prepare) Task=`583b3a51-8ed2-4219-ad65-c1f7da6e888f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:28,169::task::595::TaskManager.Task::(_updateState) Task=`583b3a51-8ed2-4219-ad65-c1f7da6e888f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:28,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:28,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:28,170::task::990::TaskManager.Task::(_decref) Task=`583b3a51-8ed2-4219-ad65-c1f7da6e888f`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:13:28,177::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:13:28,178::task::595::TaskManager.Task::(_updateState) Task=`b8ccf515-88bb-4077-9d19-5c9453a294cf`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:13:28,178::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:13:28,178::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`fc33e996-800f-4a2a-96a4-4ac78f076e3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:13:28,179::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:13:28,179::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:13:28,179::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`fc33e996-800f-4a2a-96a4-4ac78f076e3e`::Granted request >Thread-236::DEBUG::2014-03-30 11:13:28,180::task::827::TaskManager.Task::(resourceAcquired) Task=`b8ccf515-88bb-4077-9d19-5c9453a294cf`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:13:28,180::task::990::TaskManager.Task::(_decref) Task=`b8ccf515-88bb-4077-9d19-5c9453a294cf`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:13:28,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623386112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:28,181::task::1185::TaskManager.Task::(prepare) Task=`b8ccf515-88bb-4077-9d19-5c9453a294cf`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623386112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:28,181::task::595::TaskManager.Task::(_updateState) Task=`b8ccf515-88bb-4077-9d19-5c9453a294cf`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:13:28,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:13:28,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:13:28,182::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:13:28,182::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:13:28,183::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:13:28,183::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:13:28,183::task::990::TaskManager.Task::(_decref) Task=`b8ccf515-88bb-4077-9d19-5c9453a294cf`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:29,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:29,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457143 s, 22.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:29,721::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:13:30,131::task::595::TaskManager.Task::(_updateState) Task=`f1664416-379f-4847-ada7-b98b8ad1e546`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:30,131::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:13:30,132::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00429093', 'lastCheck': '5.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000396256', 'lastCheck': '3.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:13:30,132::task::1185::TaskManager.Task::(prepare) Task=`f1664416-379f-4847-ada7-b98b8ad1e546`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00429093', 'lastCheck': '5.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000396256', 'lastCheck': '3.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:13:30,132::task::595::TaskManager.Task::(_updateState) Task=`f1664416-379f-4847-ada7-b98b8ad1e546`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:30,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:30,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:30,133::task::990::TaskManager.Task::(_decref) Task=`f1664416-379f-4847-ada7-b98b8ad1e546`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:31,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:31,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372278 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:32,733::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:33,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:33,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373867 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:35,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:35,110::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00615686 s, 665 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:35,746::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:35,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:36,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0486961 s, 21.0 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:13:36,513::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:13:36,525::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000453733 s, 763 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:38,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:38,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457319 s, 22.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:13:38,215::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [560c34c] >Thread-13::DEBUG::2014-03-30 11:13:38,216::task::595::TaskManager.Task::(_updateState) Task=`30212fd7-92ac-4566-8d3e-529f1c53c231`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:38,216::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:13:38,241::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:38,241::task::1185::TaskManager.Task::(prepare) Task=`30212fd7-92ac-4566-8d3e-529f1c53c231`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:38,242::task::595::TaskManager.Task::(_updateState) Task=`30212fd7-92ac-4566-8d3e-529f1c53c231`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:38,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:38,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:38,242::task::990::TaskManager.Task::(_decref) Task=`30212fd7-92ac-4566-8d3e-529f1c53c231`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:13:38,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [560c34c] >Thread-236::DEBUG::2014-03-30 11:13:38,249::task::595::TaskManager.Task::(_updateState) Task=`b633b3ee-9c17-49da-bdd2-af2c3847b7fe`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:13:38,250::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:13:38,250::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0eaff7c2-c951-48c0-86a4-28acd3dd952f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:13:38,250::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:13:38,251::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:13:38,251::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0eaff7c2-c951-48c0-86a4-28acd3dd952f`::Granted request >Thread-236::DEBUG::2014-03-30 11:13:38,251::task::827::TaskManager.Task::(resourceAcquired) Task=`b633b3ee-9c17-49da-bdd2-af2c3847b7fe`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:13:38,252::task::990::TaskManager.Task::(_decref) Task=`b633b3ee-9c17-49da-bdd2-af2c3847b7fe`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:13:38,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623386112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:38,253::task::1185::TaskManager.Task::(prepare) Task=`b633b3ee-9c17-49da-bdd2-af2c3847b7fe`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623386112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:38,253::task::595::TaskManager.Task::(_updateState) Task=`b633b3ee-9c17-49da-bdd2-af2c3847b7fe`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:13:38,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:13:38,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:13:38,254::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:13:38,254::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:13:38,254::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:13:38,254::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:13:38,255::task::990::TaskManager.Task::(_decref) Task=`b633b3ee-9c17-49da-bdd2-af2c3847b7fe`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:13:38,758::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:40,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:40,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460148 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:41,771::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:42,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:42,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374188 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:44,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:44,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498266 s, 20.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:44,783::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:13:45,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:45,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000630184 s, 6.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:13:45,285::task::595::TaskManager.Task::(_updateState) Task=`6562f7e5-931b-45d6-8d14-f3b3fd59f046`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:45,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:13:45,285::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630184', 'lastCheck': '0.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453733', 'lastCheck': '8.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:13:45,286::task::1185::TaskManager.Task::(prepare) Task=`6562f7e5-931b-45d6-8d14-f3b3fd59f046`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000630184', 'lastCheck': '0.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453733', 'lastCheck': '8.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:13:45,286::task::595::TaskManager.Task::(_updateState) Task=`6562f7e5-931b-45d6-8d14-f3b3fd59f046`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:45,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:45,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:45,286::task::990::TaskManager.Task::(_decref) Task=`6562f7e5-931b-45d6-8d14-f3b3fd59f046`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:13:46,533::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:13:46,545::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000456634 s, 758 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:46,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:46,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458637 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:47,797::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:13:48,281::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-13::DEBUG::2014-03-30 11:13:48,281::task::595::TaskManager.Task::(_updateState) Task=`adc34f2a-eaa7-426d-b4d3-bfa0f507b16d`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:48,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:13:48,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:48,304::task::1185::TaskManager.Task::(prepare) Task=`adc34f2a-eaa7-426d-b4d3-bfa0f507b16d`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:48,304::task::595::TaskManager.Task::(_updateState) Task=`adc34f2a-eaa7-426d-b4d3-bfa0f507b16d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:48,304::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:48,304::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:48,304::task::990::TaskManager.Task::(_decref) Task=`adc34f2a-eaa7-426d-b4d3-bfa0f507b16d`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:13:48,311::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-236::DEBUG::2014-03-30 11:13:48,312::task::595::TaskManager.Task::(_updateState) Task=`67198591-f2ee-45ab-9c6f-39806087d241`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:13:48,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:13:48,312::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`50481b99-a8e8-4f15-99f3-d00e54f5c979`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:13:48,313::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:13:48,313::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:13:48,313::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`50481b99-a8e8-4f15-99f3-d00e54f5c979`::Granted request >Thread-236::DEBUG::2014-03-30 11:13:48,313::task::827::TaskManager.Task::(resourceAcquired) Task=`67198591-f2ee-45ab-9c6f-39806087d241`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:13:48,314::task::990::TaskManager.Task::(_decref) Task=`67198591-f2ee-45ab-9c6f-39806087d241`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:13:48,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623386112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:48,315::task::1185::TaskManager.Task::(prepare) Task=`67198591-f2ee-45ab-9c6f-39806087d241`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623386112', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:48,315::task::595::TaskManager.Task::(_updateState) Task=`67198591-f2ee-45ab-9c6f-39806087d241`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:13:48,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:13:48,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:13:48,315::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:13:48,316::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:13:48,316::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:13:48,316::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:13:48,316::task::990::TaskManager.Task::(_decref) Task=`67198591-f2ee-45ab-9c6f-39806087d241`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:48,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:48,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373726 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:50,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:13:50,810::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:50,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492131 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:13:52,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:53,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372895 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:53,822::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:55,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:55,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451983 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:13:55,155::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:13:55,211::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00761609 s, 538 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:13:56,572::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:13:56,583::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000449079 s, 770 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:56,833::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:13:57,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:57,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045365 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:13:58,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:13:58,348::task::595::TaskManager.Task::(_updateState) Task=`7d03afbc-86b1-4456-942b-40db13584ca7`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:13:58,348::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:13:58,360::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:58,361::task::1185::TaskManager.Task::(prepare) Task=`7d03afbc-86b1-4456-942b-40db13584ca7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:13:58,361::task::595::TaskManager.Task::(_updateState) Task=`7d03afbc-86b1-4456-942b-40db13584ca7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:13:58,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:13:58,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:13:58,362::task::990::TaskManager.Task::(_decref) Task=`7d03afbc-86b1-4456-942b-40db13584ca7`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:13:58,369::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:13:58,369::task::595::TaskManager.Task::(_updateState) Task=`c61d69a5-f322-4f81-97bc-ebbf95cb9b0b`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:13:58,369::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:13:58,370::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`552bcda0-3eb8-4b86-a5c9-6e7ddf770401`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:13:58,370::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:13:58,370::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:13:58,371::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`552bcda0-3eb8-4b86-a5c9-6e7ddf770401`::Granted request >Thread-236::DEBUG::2014-03-30 11:13:58,371::task::827::TaskManager.Task::(resourceAcquired) Task=`c61d69a5-f322-4f81-97bc-ebbf95cb9b0b`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:13:58,371::task::990::TaskManager.Task::(_decref) Task=`c61d69a5-f322-4f81-97bc-ebbf95cb9b0b`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:13:58,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013625516032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:58,373::task::1185::TaskManager.Task::(prepare) Task=`c61d69a5-f322-4f81-97bc-ebbf95cb9b0b`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013625516032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:13:58,373::task::595::TaskManager.Task::(_updateState) Task=`c61d69a5-f322-4f81-97bc-ebbf95cb9b0b`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:13:58,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:13:58,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:13:58,374::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:13:58,374::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:13:58,374::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:13:58,374::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:13:58,375::task::990::TaskManager.Task::(_decref) Task=`c61d69a5-f322-4f81-97bc-ebbf95cb9b0b`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:13:59,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:13:59,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045337 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:13:59,846::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:14:00,431::task::595::TaskManager.Task::(_updateState) Task=`fccc2cd2-89f2-41c2-8cfb-d81c8b511ede`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:00,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:14:00,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00761609', 'lastCheck': '5.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449079', 'lastCheck': '3.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:00,432::task::1185::TaskManager.Task::(prepare) Task=`fccc2cd2-89f2-41c2-8cfb-d81c8b511ede`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00761609', 'lastCheck': '5.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000449079', 'lastCheck': '3.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:00,432::task::595::TaskManager.Task::(_updateState) Task=`fccc2cd2-89f2-41c2-8cfb-d81c8b511ede`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:00,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:00,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:00,433::task::990::TaskManager.Task::(_decref) Task=`fccc2cd2-89f2-41c2-8cfb-d81c8b511ede`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:01,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:01,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371486 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:02,857::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:03,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:03,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371532 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:14:05,254::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:14:05,268::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000548017 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:05,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:05,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464833 s, 22.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:05,869::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:14:06,592::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:14:06,603::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000429636 s, 805 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:07,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:07,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464036 s, 22.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:08,400::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:14:08,401::task::595::TaskManager.Task::(_updateState) Task=`c2c51ee0-241c-4495-8493-2b0ad003f09b`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:08,401::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:14:08,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:08,421::task::1185::TaskManager.Task::(prepare) Task=`c2c51ee0-241c-4495-8493-2b0ad003f09b`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:08,422::task::595::TaskManager.Task::(_updateState) Task=`c2c51ee0-241c-4495-8493-2b0ad003f09b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:08,422::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:08,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:08,422::task::990::TaskManager.Task::(_decref) Task=`c2c51ee0-241c-4495-8493-2b0ad003f09b`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:14:08,430::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:14:08,431::task::595::TaskManager.Task::(_updateState) Task=`6ae2d061-5c26-41fe-8fd4-44bf87326c6d`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:14:08,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:14:08,431::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`1bcbfec2-ae84-4464-a2a8-088e4a6bc8b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:14:08,432::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:14:08,432::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:14:08,432::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`1bcbfec2-ae84-4464-a2a8-088e4a6bc8b6`::Granted request >Thread-236::DEBUG::2014-03-30 11:14:08,433::task::827::TaskManager.Task::(resourceAcquired) Task=`6ae2d061-5c26-41fe-8fd4-44bf87326c6d`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:14:08,433::task::990::TaskManager.Task::(_decref) Task=`6ae2d061-5c26-41fe-8fd4-44bf87326c6d`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:14:08,434::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013625516032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:08,434::task::1185::TaskManager.Task::(prepare) Task=`6ae2d061-5c26-41fe-8fd4-44bf87326c6d`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013625516032', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:08,434::task::595::TaskManager.Task::(_updateState) Task=`6ae2d061-5c26-41fe-8fd4-44bf87326c6d`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:14:08,435::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:14:08,435::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:14:08,435::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:14:08,435::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:14:08,436::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:14:08,436::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:14:08,436::task::990::TaskManager.Task::(_decref) Task=`6ae2d061-5c26-41fe-8fd4-44bf87326c6d`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:14:08,880::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:09,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:10,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454926 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:11,892::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:12,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:12,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0617707 s, 16.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:14,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:14,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376561 s, 27.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:14,918::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:14:15,283::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:14:15,305::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00680677 s, 602 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:15,605::task::595::TaskManager.Task::(_updateState) Task=`b4eaac31-bbe9-4676-aba9-9c8aae2177f8`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:15,605::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:14:15,606::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00680677', 'lastCheck': '0.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429636', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:15,606::task::1185::TaskManager.Task::(prepare) Task=`b4eaac31-bbe9-4676-aba9-9c8aae2177f8`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00680677', 'lastCheck': '0.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000429636', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:15,606::task::595::TaskManager.Task::(_updateState) Task=`b4eaac31-bbe9-4676-aba9-9c8aae2177f8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:15,606::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:15,606::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:15,607::task::990::TaskManager.Task::(_decref) Task=`b4eaac31-bbe9-4676-aba9-9c8aae2177f8`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:16,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:16,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488941 s, 20.9 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:14:16,614::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:14:16,627::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000449624 s, 770 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:17,943::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:14:18,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:14:18,464::task::595::TaskManager.Task::(_updateState) Task=`3c719e73-9271-48c4-b107-046d0910acdf`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:18,464::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Dummy-36::DEBUG::2014-03-30 11:14:18,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::INFO::2014-03-30 11:14:18,484::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:18,485::task::1185::TaskManager.Task::(prepare) Task=`3c719e73-9271-48c4-b107-046d0910acdf`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:18,486::task::595::TaskManager.Task::(_updateState) Task=`3c719e73-9271-48c4-b107-046d0910acdf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:18,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:18,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:18,486::task::990::TaskManager.Task::(_decref) Task=`3c719e73-9271-48c4-b107-046d0910acdf`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:14:18,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:14:18,494::task::595::TaskManager.Task::(_updateState) Task=`26e353ed-307e-4d5a-98a8-bb894dc8d7e7`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:14:18,494::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:14:18,495::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`c9f2eb66-9a96-405a-806a-09c05d733a21`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:14:18,496::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:14:18,497::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:14:18,497::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`c9f2eb66-9a96-405a-806a-09c05d733a21`::Granted request >Thread-236::DEBUG::2014-03-30 11:14:18,498::task::827::TaskManager.Task::(resourceAcquired) Task=`26e353ed-307e-4d5a-98a8-bb894dc8d7e7`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:14:18,499::task::990::TaskManager.Task::(_decref) Task=`26e353ed-307e-4d5a-98a8-bb894dc8d7e7`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:14:18,501::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623418880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:18,501::task::1185::TaskManager.Task::(prepare) Task=`26e353ed-307e-4d5a-98a8-bb894dc8d7e7`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013623418880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:18,502::task::595::TaskManager.Task::(_updateState) Task=`26e353ed-307e-4d5a-98a8-bb894dc8d7e7`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:14:18,503::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:14:18,504::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:14:18,504::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:14:18,505::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:14:18,506::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:14:18,506::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:14:18,507::task::990::TaskManager.Task::(_decref) Task=`26e353ed-307e-4d5a-98a8-bb894dc8d7e7`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:18,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0514295 s, 19.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:20,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:20,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451958 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:20,958::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:22,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:22,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373275 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:23,970::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:24,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:24,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451371 s, 22.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:14:25,313::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:14:25,331::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00529714 s, 773 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:14:26,638::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:14:26,650::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000372355 s, 929 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:26,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:14:26,984::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:27,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050184 s, 20.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:28,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [873f829] >Thread-13::DEBUG::2014-03-30 11:14:28,535::task::595::TaskManager.Task::(_updateState) Task=`8bad693a-f531-4511-ba95-dc257707144e`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:28,535::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:14:28,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:28,558::task::1185::TaskManager.Task::(prepare) Task=`8bad693a-f531-4511-ba95-dc257707144e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:28,558::task::595::TaskManager.Task::(_updateState) Task=`8bad693a-f531-4511-ba95-dc257707144e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:28,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:28,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:28,559::task::990::TaskManager.Task::(_decref) Task=`8bad693a-f531-4511-ba95-dc257707144e`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:14:28,564::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [873f829] >Thread-236::DEBUG::2014-03-30 11:14:28,564::task::595::TaskManager.Task::(_updateState) Task=`85097b0d-c40f-4b79-ac17-a8734aeb19d6`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:14:28,564::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:14:28,565::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0df3478e-513e-4d56-b544-dc21ea4a54ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:14:28,565::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:14:28,565::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:14:28,566::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0df3478e-513e-4d56-b544-dc21ea4a54ae`::Granted request >Thread-236::DEBUG::2014-03-30 11:14:28,566::task::827::TaskManager.Task::(resourceAcquired) Task=`85097b0d-c40f-4b79-ac17-a8734aeb19d6`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:14:28,566::task::990::TaskManager.Task::(_decref) Task=`85097b0d-c40f-4b79-ac17-a8734aeb19d6`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:14:28,567::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013620469760', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:28,567::task::1185::TaskManager.Task::(prepare) Task=`85097b0d-c40f-4b79-ac17-a8734aeb19d6`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013620469760', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:28,567::task::595::TaskManager.Task::(_updateState) Task=`85097b0d-c40f-4b79-ac17-a8734aeb19d6`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:14:28,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:14:28,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:14:28,568::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:14:28,568::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:14:28,568::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:14:28,568::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:14:28,569::task::990::TaskManager.Task::(_decref) Task=`85097b0d-c40f-4b79-ac17-a8734aeb19d6`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:29,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:29,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373633 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:29,995::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:14:30,748::task::595::TaskManager.Task::(_updateState) Task=`efe49d27-9528-4930-9cc8-4db59ad1db2a`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:30,748::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:14:30,748::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00529714', 'lastCheck': '5.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372355', 'lastCheck': '4.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:30,749::task::1185::TaskManager.Task::(prepare) Task=`efe49d27-9528-4930-9cc8-4db59ad1db2a`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00529714', 'lastCheck': '5.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000372355', 'lastCheck': '4.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:30,749::task::595::TaskManager.Task::(_updateState) Task=`efe49d27-9528-4930-9cc8-4db59ad1db2a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:30,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:30,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:30,749::task::990::TaskManager.Task::(_decref) Task=`efe49d27-9528-4930-9cc8-4db59ad1db2a`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:31,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:31,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373814 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:33,007::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:33,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:33,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374504 s, 27.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:14:35,340::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:14:35,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564012 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:35,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:35,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453315 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:36,019::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:14:36,659::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:14:36,670::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000436366 s, 793 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:37,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:37,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452933 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:38,607::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:14:38,608::task::595::TaskManager.Task::(_updateState) Task=`be711d53-0d9e-4a85-af96-d1ca409a6bf7`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:38,608::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:14:38,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:38,624::task::1185::TaskManager.Task::(prepare) Task=`be711d53-0d9e-4a85-af96-d1ca409a6bf7`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:38,624::task::595::TaskManager.Task::(_updateState) Task=`be711d53-0d9e-4a85-af96-d1ca409a6bf7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:38,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:38,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:38,625::task::990::TaskManager.Task::(_decref) Task=`be711d53-0d9e-4a85-af96-d1ca409a6bf7`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:14:38,632::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:14:38,632::task::595::TaskManager.Task::(_updateState) Task=`398c1257-0d34-4ccf-b7d0-4d34d52065e3`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:14:38,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:14:38,633::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`93a0bdcd-6680-4c0f-8e3a-b7bd712bd2e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:14:38,633::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:14:38,634::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:14:38,634::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`93a0bdcd-6680-4c0f-8e3a-b7bd712bd2e2`::Granted request >Thread-236::DEBUG::2014-03-30 11:14:38,634::task::827::TaskManager.Task::(resourceAcquired) Task=`398c1257-0d34-4ccf-b7d0-4d34d52065e3`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:14:38,635::task::990::TaskManager.Task::(_decref) Task=`398c1257-0d34-4ccf-b7d0-4d34d52065e3`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:14:38,636::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013620469760', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:38,636::task::1185::TaskManager.Task::(prepare) Task=`398c1257-0d34-4ccf-b7d0-4d34d52065e3`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013620469760', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:38,636::task::595::TaskManager.Task::(_updateState) Task=`398c1257-0d34-4ccf-b7d0-4d34d52065e3`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:14:38,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:14:38,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:14:38,637::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:14:38,637::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:14:38,637::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:14:38,637::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:14:38,638::task::990::TaskManager.Task::(_decref) Task=`398c1257-0d34-4ccf-b7d0-4d34d52065e3`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:14:39,031::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:39,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:39,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454995 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:41,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:41,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461221 s, 22.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:42,043::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:43,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:44,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037453 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:45,055::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:14:45,362::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:14:45,381::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00632436 s, 648 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:45,889::task::595::TaskManager.Task::(_updateState) Task=`4cd6dd7a-54bc-4cb9-926f-8b5e4f0a6d96`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:45,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:14:45,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00632436', 'lastCheck': '0.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436366', 'lastCheck': '9.2', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:45,890::task::1185::TaskManager.Task::(prepare) Task=`4cd6dd7a-54bc-4cb9-926f-8b5e4f0a6d96`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00632436', 'lastCheck': '0.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000436366', 'lastCheck': '9.2', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:14:45,890::task::595::TaskManager.Task::(_updateState) Task=`4cd6dd7a-54bc-4cb9-926f-8b5e4f0a6d96`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:45,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:45,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:45,891::task::990::TaskManager.Task::(_decref) Task=`4cd6dd7a-54bc-4cb9-926f-8b5e4f0a6d96`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:46,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:46,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455622 s, 22.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:14:46,681::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:14:46,693::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000438144 s, 790 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:48,068::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:48,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:48,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454722 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:48,660::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:14:48,661::task::595::TaskManager.Task::(_updateState) Task=`e55f5c9f-3b76-45a8-829a-676520eefc08`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:48,661::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:14:48,695::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:48,695::task::1185::TaskManager.Task::(prepare) Task=`e55f5c9f-3b76-45a8-829a-676520eefc08`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:48,695::task::595::TaskManager.Task::(_updateState) Task=`e55f5c9f-3b76-45a8-829a-676520eefc08`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:48,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:48,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:48,696::task::990::TaskManager.Task::(_decref) Task=`e55f5c9f-3b76-45a8-829a-676520eefc08`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:14:48,703::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:14:48,704::task::595::TaskManager.Task::(_updateState) Task=`346467dc-59a3-44a7-beb0-4a2ed3a57cb6`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:14:48,704::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:14:48,705::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6a6350e2-60db-438c-948c-20cc3a39cdba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:14:48,705::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:14:48,705::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:14:48,705::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6a6350e2-60db-438c-948c-20cc3a39cdba`::Granted request >Thread-236::DEBUG::2014-03-30 11:14:48,705::task::827::TaskManager.Task::(resourceAcquired) Task=`346467dc-59a3-44a7-beb0-4a2ed3a57cb6`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:14:48,706::task::990::TaskManager.Task::(_decref) Task=`346467dc-59a3-44a7-beb0-4a2ed3a57cb6`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:14:48,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013620469760', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:48,707::task::1185::TaskManager.Task::(prepare) Task=`346467dc-59a3-44a7-beb0-4a2ed3a57cb6`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013620469760', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:48,707::task::595::TaskManager.Task::(_updateState) Task=`346467dc-59a3-44a7-beb0-4a2ed3a57cb6`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:14:48,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:14:48,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:14:48,707::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:14:48,708::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:14:48,708::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:14:48,708::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:14:48,708::task::990::TaskManager.Task::(_decref) Task=`346467dc-59a3-44a7-beb0-4a2ed3a57cb6`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:50,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:50,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.124881 s, 8.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:51,080::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:52,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:52,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375209 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:14:54,092::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:54,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:55,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497015 s, 20.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:14:55,390::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:14:55,404::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000559059 s, 7.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:14:56,704::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:14:56,715::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000359287 s, 963 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:14:57,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:14:57,106::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:14:57,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455581 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:14:58,734::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:14:58,735::task::595::TaskManager.Task::(_updateState) Task=`6a63782e-39e3-47fa-afce-704319231903`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:14:58,735::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:14:58,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:58,777::task::1185::TaskManager.Task::(prepare) Task=`6a63782e-39e3-47fa-afce-704319231903`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:14:58,778::task::595::TaskManager.Task::(_updateState) Task=`6a63782e-39e3-47fa-afce-704319231903`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:14:58,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:14:58,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:14:58,778::task::990::TaskManager.Task::(_decref) Task=`6a63782e-39e3-47fa-afce-704319231903`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:14:58,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:14:58,785::task::595::TaskManager.Task::(_updateState) Task=`67dc0b98-7b61-4aaa-9bba-21b268949a10`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:14:58,785::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:14:58,786::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`87253439-ba04-4ca9-a457-206fb003e897`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:14:58,786::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:14:58,786::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:14:58,786::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`87253439-ba04-4ca9-a457-206fb003e897`::Granted request >Thread-236::DEBUG::2014-03-30 11:14:58,787::task::827::TaskManager.Task::(resourceAcquired) Task=`67dc0b98-7b61-4aaa-9bba-21b268949a10`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:14:58,787::task::990::TaskManager.Task::(_decref) Task=`67dc0b98-7b61-4aaa-9bba-21b268949a10`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:14:58,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616930816', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:58,788::task::1185::TaskManager.Task::(prepare) Task=`67dc0b98-7b61-4aaa-9bba-21b268949a10`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616930816', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:14:58,788::task::595::TaskManager.Task::(_updateState) Task=`67dc0b98-7b61-4aaa-9bba-21b268949a10`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:14:58,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:14:58,789::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:14:58,789::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:14:58,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:14:58,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:14:58,789::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:14:58,789::task::990::TaskManager.Task::(_decref) Task=`67dc0b98-7b61-4aaa-9bba-21b268949a10`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:14:59,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:14:59,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376729 s, 27.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:00,117::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:15:01,039::task::595::TaskManager.Task::(_updateState) Task=`9f6a09b0-a8fb-4799-b061-193db6bfeffc`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:01,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:15:01,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559059', 'lastCheck': '5.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359287', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:01,040::task::1185::TaskManager.Task::(prepare) Task=`9f6a09b0-a8fb-4799-b061-193db6bfeffc`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000559059', 'lastCheck': '5.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000359287', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:01,040::task::595::TaskManager.Task::(_updateState) Task=`9f6a09b0-a8fb-4799-b061-193db6bfeffc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:01,040::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:01,040::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:01,040::task::990::TaskManager.Task::(_decref) Task=`9f6a09b0-a8fb-4799-b061-193db6bfeffc`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:15:01,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:01,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374402 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:03,129::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:03,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:03,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037703 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:15:05,412::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:15:05,434::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00900504 s, 455 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:05,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:05,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457212 s, 22.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:06,140::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:15:06,724::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:15:06,736::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000433914 s, 797 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:07,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:07,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453156 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:15:08,817::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:15:08,818::task::595::TaskManager.Task::(_updateState) Task=`8083be64-e0fa-47b0-a67f-bdc4e4c21e0c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:08,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:15:08,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:08,848::task::1185::TaskManager.Task::(prepare) Task=`8083be64-e0fa-47b0-a67f-bdc4e4c21e0c`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:08,849::task::595::TaskManager.Task::(_updateState) Task=`8083be64-e0fa-47b0-a67f-bdc4e4c21e0c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:08,849::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:08,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:08,849::task::990::TaskManager.Task::(_decref) Task=`8083be64-e0fa-47b0-a67f-bdc4e4c21e0c`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:15:08,856::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:15:08,857::task::595::TaskManager.Task::(_updateState) Task=`6516dab2-cec0-46c0-b585-63c0df7182a7`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:15:08,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:15:08,857::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`661af89f-1485-40d8-864e-28cc5a55e3dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:15:08,858::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:15:08,858::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:15:08,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`661af89f-1485-40d8-864e-28cc5a55e3dc`::Granted request >Thread-236::DEBUG::2014-03-30 11:15:08,859::task::827::TaskManager.Task::(resourceAcquired) Task=`6516dab2-cec0-46c0-b585-63c0df7182a7`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:15:08,859::task::990::TaskManager.Task::(_decref) Task=`6516dab2-cec0-46c0-b585-63c0df7182a7`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:15:08,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616209920', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:08,860::task::1185::TaskManager.Task::(prepare) Task=`6516dab2-cec0-46c0-b585-63c0df7182a7`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616209920', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:08,860::task::595::TaskManager.Task::(_updateState) Task=`6516dab2-cec0-46c0-b585-63c0df7182a7`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:15:08,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:15:08,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:15:08,861::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:15:08,861::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:15:08,861::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:15:08,862::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:15:08,862::task::990::TaskManager.Task::(_decref) Task=`6516dab2-cec0-46c0-b585-63c0df7182a7`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:15:09,156::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:09,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:09,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457458 s, 22.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:11,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:12,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454871 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:12,168::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:14,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:14,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373915 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:15,181::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:15:15,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:15:15,461::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00629638 s, 651 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:16,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:15:16,198::task::595::TaskManager.Task::(_updateState) Task=`d6347047-23f1-471f-b25e-0662cefd7940`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:16,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:15:16,202::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00629638', 'lastCheck': '0.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433914', 'lastCheck': '9.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:16,203::task::1185::TaskManager.Task::(prepare) Task=`d6347047-23f1-471f-b25e-0662cefd7940`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00629638', 'lastCheck': '0.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000433914', 'lastCheck': '9.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:16,204::task::595::TaskManager.Task::(_updateState) Task=`d6347047-23f1-471f-b25e-0662cefd7940`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:16,205::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:16,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:16,208::task::990::TaskManager.Task::(_decref) Task=`d6347047-23f1-471f-b25e-0662cefd7940`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:15:16,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0838731 s, 12.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:15:16,746::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:15:16,758::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000447179 s, 774 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:18,193::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:18,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:18,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491058 s, 20.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:15:18,888::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:15:18,888::task::595::TaskManager.Task::(_updateState) Task=`6ff914aa-b74d-4ab3-bb3b-f006acca30e0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:18,889::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:15:18,915::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:18,915::task::1185::TaskManager.Task::(prepare) Task=`6ff914aa-b74d-4ab3-bb3b-f006acca30e0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:18,915::task::595::TaskManager.Task::(_updateState) Task=`6ff914aa-b74d-4ab3-bb3b-f006acca30e0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:18,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:18,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:18,916::task::990::TaskManager.Task::(_decref) Task=`6ff914aa-b74d-4ab3-bb3b-f006acca30e0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:15:18,921::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:15:18,922::task::595::TaskManager.Task::(_updateState) Task=`9dc7c25e-b743-42b0-a2a6-a2847e974f70`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:15:18,922::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:15:18,923::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`77675b23-5b1e-438c-80ad-e1e4572efdd0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:15:18,923::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:15:18,923::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:15:18,923::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`77675b23-5b1e-438c-80ad-e1e4572efdd0`::Granted request >Thread-236::DEBUG::2014-03-30 11:15:18,924::task::827::TaskManager.Task::(resourceAcquired) Task=`9dc7c25e-b743-42b0-a2a6-a2847e974f70`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:15:18,924::task::990::TaskManager.Task::(_decref) Task=`9dc7c25e-b743-42b0-a2a6-a2847e974f70`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:15:18,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616209920', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:18,925::task::1185::TaskManager.Task::(prepare) Task=`9dc7c25e-b743-42b0-a2a6-a2847e974f70`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616209920', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:18,926::task::595::TaskManager.Task::(_updateState) Task=`9dc7c25e-b743-42b0-a2a6-a2847e974f70`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:15:18,926::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:15:18,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:15:18,926::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:15:18,927::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:15:18,927::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:15:18,927::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:15:18,927::task::990::TaskManager.Task::(_decref) Task=`9dc7c25e-b743-42b0-a2a6-a2847e974f70`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:15:20,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:20,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455383 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:21,206::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:22,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:22,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377326 s, 27.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:24,217::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:24,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:24,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377033 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:15:25,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:15:25,487::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00545079 s, 751 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:15:26,770::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:15:26,781::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000303917 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:26,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:26,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459182 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:27,231::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:28,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:15:28,954::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:15:28,956::task::595::TaskManager.Task::(_updateState) Task=`7457ce7a-2870-462a-af86-52f22ac6631e`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:28,957::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:15:28,981::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:28,982::task::1185::TaskManager.Task::(prepare) Task=`7457ce7a-2870-462a-af86-52f22ac6631e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:28,982::task::595::TaskManager.Task::(_updateState) Task=`7457ce7a-2870-462a-af86-52f22ac6631e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:28,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:28,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:28,984::task::990::TaskManager.Task::(_decref) Task=`7457ce7a-2870-462a-af86-52f22ac6631e`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:15:28,994::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:15:28,996::task::595::TaskManager.Task::(_updateState) Task=`ac28a478-1ce0-44b0-a93d-515f08e73d61`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:15:28,997::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:15:29,000::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`64dab2f6-8509-49dd-86b6-e5befd7b1ef8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:15:29,001::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:15:29,003::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:15:29,004::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`64dab2f6-8509-49dd-86b6-e5befd7b1ef8`::Granted request >Thread-236::DEBUG::2014-03-30 11:15:29,006::task::827::TaskManager.Task::(resourceAcquired) Task=`ac28a478-1ce0-44b0-a93d-515f08e73d61`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:15:29,008::task::990::TaskManager.Task::(_decref) Task=`ac28a478-1ce0-44b0-a93d-515f08e73d61`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:15:29,013::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615947776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:29,014::task::1185::TaskManager.Task::(prepare) Task=`ac28a478-1ce0-44b0-a93d-515f08e73d61`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615947776', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:29,015::task::595::TaskManager.Task::(_updateState) Task=`ac28a478-1ce0-44b0-a93d-515f08e73d61`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:15:29,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:15:29,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:15:29,019::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:15:29,021::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:15:29,022::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:15:29,023::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:15:29,024::task::990::TaskManager.Task::(_decref) Task=`ac28a478-1ce0-44b0-a93d-515f08e73d61`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:15:29,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485208 s, 21.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:30,243::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:31,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:31,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375688 s, 27.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:15:31,382::task::595::TaskManager.Task::(_updateState) Task=`c214e9e7-e089-4563-923f-b40a3c359132`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:31,382::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:15:31,382::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545079', 'lastCheck': '5.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303917', 'lastCheck': '4.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:31,383::task::1185::TaskManager.Task::(prepare) Task=`c214e9e7-e089-4563-923f-b40a3c359132`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00545079', 'lastCheck': '5.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000303917', 'lastCheck': '4.6', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:31,383::task::595::TaskManager.Task::(_updateState) Task=`c214e9e7-e089-4563-923f-b40a3c359132`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:31,383::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:31,383::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:31,383::task::990::TaskManager.Task::(_decref) Task=`c214e9e7-e089-4563-923f-b40a3c359132`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:15:33,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:15:33,256::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:33,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048981 s, 20.9 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:35,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:35,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455236 s, 22.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:15:35,496::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:15:35,514::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00466419 s, 878 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:36,267::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:15:36,789::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:15:36,801::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000357739 s, 967 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:37,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:37,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500701 s, 20.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:15:39,075::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:15:39,076::task::595::TaskManager.Task::(_updateState) Task=`337ad962-bbc3-4074-aa4d-e726ba9500ac`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:39,076::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:15:39,108::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:39,109::task::1185::TaskManager.Task::(prepare) Task=`337ad962-bbc3-4074-aa4d-e726ba9500ac`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:39,109::task::595::TaskManager.Task::(_updateState) Task=`337ad962-bbc3-4074-aa4d-e726ba9500ac`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:39,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:39,109::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:39,110::task::990::TaskManager.Task::(_decref) Task=`337ad962-bbc3-4074-aa4d-e726ba9500ac`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:15:39,116::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:15:39,117::task::595::TaskManager.Task::(_updateState) Task=`b6aa48fe-bff3-4352-8a59-802b44d8be64`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:15:39,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:15:39,118::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`c35ab262-333b-4b7e-b610-c0138c11f3d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:15:39,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:15:39,118::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:15:39,118::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`c35ab262-333b-4b7e-b610-c0138c11f3d9`::Granted request >Thread-236::DEBUG::2014-03-30 11:15:39,119::task::827::TaskManager.Task::(resourceAcquired) Task=`b6aa48fe-bff3-4352-8a59-802b44d8be64`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:15:39,119::task::990::TaskManager.Task::(_decref) Task=`b6aa48fe-bff3-4352-8a59-802b44d8be64`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:15:39,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615816704', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:39,120::task::1185::TaskManager.Task::(prepare) Task=`b6aa48fe-bff3-4352-8a59-802b44d8be64`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615816704', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:39,121::task::595::TaskManager.Task::(_updateState) Task=`b6aa48fe-bff3-4352-8a59-802b44d8be64`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:15:39,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:15:39,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:15:39,121::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:15:39,121::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:15:39,122::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:15:39,122::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:15:39,122::task::990::TaskManager.Task::(_decref) Task=`b6aa48fe-bff3-4352-8a59-802b44d8be64`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:15:39,279::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:39,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:39,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037376 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:41,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:41,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453147 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:42,291::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:43,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:43,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374411 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:45,303::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:15:45,522::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:15:45,535::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000544388 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:45,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:46,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453698 s, 22.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:15:46,544::task::595::TaskManager.Task::(_updateState) Task=`606ec28c-cee9-4205-ae87-638a8c0f9f93`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:46,544::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:15:46,545::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544388', 'lastCheck': '1.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000357739', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:46,545::task::1185::TaskManager.Task::(prepare) Task=`606ec28c-cee9-4205-ae87-638a8c0f9f93`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000544388', 'lastCheck': '1.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000357739', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:15:46,545::task::595::TaskManager.Task::(_updateState) Task=`606ec28c-cee9-4205-ae87-638a8c0f9f93`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:46,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:46,546::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:46,546::task::990::TaskManager.Task::(_decref) Task=`606ec28c-cee9-4205-ae87-638a8c0f9f93`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:15:46,811::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:15:46,823::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000462564 s, 748 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:48,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:48,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452659 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:48,315::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:15:49,156::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-13::DEBUG::2014-03-30 11:15:49,156::task::595::TaskManager.Task::(_updateState) Task=`5e1cc168-38f5-4517-82ff-635f31fdf04f`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:49,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:15:49,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:49,179::task::1185::TaskManager.Task::(prepare) Task=`5e1cc168-38f5-4517-82ff-635f31fdf04f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:49,179::task::595::TaskManager.Task::(_updateState) Task=`5e1cc168-38f5-4517-82ff-635f31fdf04f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:49,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:49,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:49,179::task::990::TaskManager.Task::(_decref) Task=`5e1cc168-38f5-4517-82ff-635f31fdf04f`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:15:49,185::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-236::DEBUG::2014-03-30 11:15:49,185::task::595::TaskManager.Task::(_updateState) Task=`2bc9edbc-349a-4297-bd95-6f4b0fa78b68`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:15:49,185::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:15:49,186::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3a4512bf-91fd-44b6-825c-3474b7065b56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:15:49,186::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:15:49,186::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:15:49,186::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`3a4512bf-91fd-44b6-825c-3474b7065b56`::Granted request >Thread-236::DEBUG::2014-03-30 11:15:49,187::task::827::TaskManager.Task::(resourceAcquired) Task=`2bc9edbc-349a-4297-bd95-6f4b0fa78b68`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:15:49,187::task::990::TaskManager.Task::(_decref) Task=`2bc9edbc-349a-4297-bd95-6f4b0fa78b68`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:15:49,188::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615816704', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:49,188::task::1185::TaskManager.Task::(prepare) Task=`2bc9edbc-349a-4297-bd95-6f4b0fa78b68`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615816704', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:49,188::task::595::TaskManager.Task::(_updateState) Task=`2bc9edbc-349a-4297-bd95-6f4b0fa78b68`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:15:49,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:15:49,188::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:15:49,189::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:15:49,189::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:15:49,189::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:15:49,189::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:15:49,189::task::990::TaskManager.Task::(_decref) Task=`2bc9edbc-349a-4297-bd95-6f4b0fa78b68`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:15:50,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:50,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455376 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:51,327::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:52,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:52,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376257 s, 27.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:54,339::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:54,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:54,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373334 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:15:55,544::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:15:55,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0113583 s, 361 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:15:56,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:56,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453354 s, 22.6 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:15:56,825::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114 >Thread-15::DEBUG::2014-03-30 11:15:56,831::fileSD::140::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114 >Thread-15::DEBUG::2014-03-30 11:15:56,832::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-15::DEBUG::2014-03-30 11:15:56,838::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Backup', 'DESCRIPTION=Export', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=0', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', 'REMOTE_PATH=10.35.160.108:/RHEV/kuk', 'ROLE=Regular', 'SDUUID=3ffbee88-0d84-4a95-bba0-e8c2b2cfc114', 'TYPE=NFS', 'VERSION=0', '_SHA_CKSUM=395010f55dbb653af315d0ae088b6cc18568bd44'] >Thread-15::DEBUG::2014-03-30 11:15:56,840::fileSD::575::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-15::INFO::2014-03-30 11:15:56,840::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114_imageNS already registered >Thread-15::INFO::2014-03-30 11:15:56,840::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 3ffbee88-0d84-4a95-bba0-e8c2b2cfc114_volumeNS already registered >Thread-15::DEBUG::2014-03-30 11:15:56,848::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:15:56,860::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000439566 s, 787 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:15:57,351::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:15:58,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:15:58,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037339 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:15:59,217::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [7913ffd] >Thread-13::DEBUG::2014-03-30 11:15:59,218::task::595::TaskManager.Task::(_updateState) Task=`b48f26aa-c214-4f7e-8f81-03c4bd6b643f`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:15:59,218::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:15:59,524::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:59,525::task::1185::TaskManager.Task::(prepare) Task=`b48f26aa-c214-4f7e-8f81-03c4bd6b643f`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:15:59,525::task::595::TaskManager.Task::(_updateState) Task=`b48f26aa-c214-4f7e-8f81-03c4bd6b643f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:15:59,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:15:59,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:15:59,526::task::990::TaskManager.Task::(_decref) Task=`b48f26aa-c214-4f7e-8f81-03c4bd6b643f`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:15:59,531::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [7913ffd] >Thread-236::DEBUG::2014-03-30 11:15:59,531::task::595::TaskManager.Task::(_updateState) Task=`0e1d9ebd-71d1-4c48-b516-c93cbee55d77`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:15:59,532::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:15:59,533::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`004640cc-eee0-4e8e-98ca-0629dd002c43`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:15:59,534::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:15:59,534::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:15:59,534::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`004640cc-eee0-4e8e-98ca-0629dd002c43`::Granted request >Thread-236::DEBUG::2014-03-30 11:15:59,535::task::827::TaskManager.Task::(resourceAcquired) Task=`0e1d9ebd-71d1-4c48-b516-c93cbee55d77`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:15:59,535::task::990::TaskManager.Task::(_decref) Task=`0e1d9ebd-71d1-4c48-b516-c93cbee55d77`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:15:59,536::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013347577856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:59,536::task::1185::TaskManager.Task::(prepare) Task=`0e1d9ebd-71d1-4c48-b516-c93cbee55d77`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013347577856', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:15:59,536::task::595::TaskManager.Task::(_updateState) Task=`0e1d9ebd-71d1-4c48-b516-c93cbee55d77`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:15:59,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:15:59,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:15:59,537::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:15:59,537::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:15:59,538::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:15:59,538::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:15:59,538::task::990::TaskManager.Task::(_decref) Task=`0e1d9ebd-71d1-4c48-b516-c93cbee55d77`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:16:00,362::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:00,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:00,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378126 s, 27.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:16:01,699::task::595::TaskManager.Task::(_updateState) Task=`09f6ebaa-224b-46f9-9da2-90962ef11441`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:01,699::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:16:01,700::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113583', 'lastCheck': '6.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439566', 'lastCheck': '4.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:01,700::task::1185::TaskManager.Task::(prepare) Task=`09f6ebaa-224b-46f9-9da2-90962ef11441`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113583', 'lastCheck': '6.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439566', 'lastCheck': '4.8', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:01,700::task::595::TaskManager.Task::(_updateState) Task=`09f6ebaa-224b-46f9-9da2-90962ef11441`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:01,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:01,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:01,701::task::990::TaskManager.Task::(_decref) Task=`09f6ebaa-224b-46f9-9da2-90962ef11441`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:02,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:03,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045145 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:03,374::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:05,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:05,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037073 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:16:05,576::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:16:05,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00539114 s, 760 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:06,386::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:16:06,869::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:06,881::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000461967 s, 749 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:07,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:07,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450853 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:09,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:09,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456505 s, 22.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:09,402::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:16:09,569::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:16:09,569::task::595::TaskManager.Task::(_updateState) Task=`5bab6fe7-c6ce-49eb-a8cf-1d2b39395045`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:09,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:16:09,600::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:09,600::task::1185::TaskManager.Task::(prepare) Task=`5bab6fe7-c6ce-49eb-a8cf-1d2b39395045`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:09,600::task::595::TaskManager.Task::(_updateState) Task=`5bab6fe7-c6ce-49eb-a8cf-1d2b39395045`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:09,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:09,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:09,600::task::990::TaskManager.Task::(_decref) Task=`5bab6fe7-c6ce-49eb-a8cf-1d2b39395045`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:16:09,610::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:16:09,610::task::595::TaskManager.Task::(_updateState) Task=`ed52be9a-3f75-4146-9882-fe8360513f5a`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:16:09,610::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:16:09,611::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0ed09223-a15f-4075-b2ae-b3b4084c87d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:16:09,611::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:16:09,611::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:16:09,611::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`0ed09223-a15f-4075-b2ae-b3b4084c87d4`::Granted request >Thread-236::DEBUG::2014-03-30 11:16:09,612::task::827::TaskManager.Task::(resourceAcquired) Task=`ed52be9a-3f75-4146-9882-fe8360513f5a`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:16:09,612::task::990::TaskManager.Task::(_decref) Task=`ed52be9a-3f75-4146-9882-fe8360513f5a`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:16:09,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013205626880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:09,613::task::1185::TaskManager.Task::(prepare) Task=`ed52be9a-3f75-4146-9882-fe8360513f5a`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013205626880', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:09,613::task::595::TaskManager.Task::(_updateState) Task=`ed52be9a-3f75-4146-9882-fe8360513f5a`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:16:09,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:16:09,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:16:09,614::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:16:09,614::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:16:09,614::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:16:09,615::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:16:09,615::task::990::TaskManager.Task::(_decref) Task=`ed52be9a-3f75-4146-9882-fe8360513f5a`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:11,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:11,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458926 s, 22.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:12,413::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:13,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:13,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372075 s, 27.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:15,424::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:16:15,602::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:16:15,629::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0137132 s, 299 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:15,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:15,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045489 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:16:16,846::task::595::TaskManager.Task::(_updateState) Task=`64303a04-7e66-4fb3-b7a2-8fe7e459dba1`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:16,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:16:16,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0137132', 'lastCheck': '1.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461967', 'lastCheck': '10.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:16,847::task::1185::TaskManager.Task::(prepare) Task=`64303a04-7e66-4fb3-b7a2-8fe7e459dba1`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0137132', 'lastCheck': '1.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000461967', 'lastCheck': '10.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:16,847::task::595::TaskManager.Task::(_updateState) Task=`64303a04-7e66-4fb3-b7a2-8fe7e459dba1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:16,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:16,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:16,847::task::990::TaskManager.Task::(_decref) Task=`64303a04-7e66-4fb3-b7a2-8fe7e459dba1`::ref 0 aborting False >Thread-15::DEBUG::2014-03-30 11:16:16,891::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:16,903::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000452334 s, 765 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:17,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:17,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451559 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:18,436::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:16:19,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:16:19,642::task::595::TaskManager.Task::(_updateState) Task=`f6b8323e-dc6e-4cdd-8242-d2f34fd862e3`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:19,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:16:19,670::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:19,670::task::1185::TaskManager.Task::(prepare) Task=`f6b8323e-dc6e-4cdd-8242-d2f34fd862e3`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:19,670::task::595::TaskManager.Task::(_updateState) Task=`f6b8323e-dc6e-4cdd-8242-d2f34fd862e3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:19,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:19,670::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:19,671::task::990::TaskManager.Task::(_decref) Task=`f6b8323e-dc6e-4cdd-8242-d2f34fd862e3`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:16:19,677::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:16:19,677::task::595::TaskManager.Task::(_updateState) Task=`fc21b8a2-4f0f-42ce-9027-47ba55fb1ee0`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:16:19,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:16:19,678::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`67d2ed7d-c24a-45f7-a576-fcba70e3061c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:16:19,678::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:16:19,678::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:16:19,679::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`67d2ed7d-c24a-45f7-a576-fcba70e3061c`::Granted request >Thread-236::DEBUG::2014-03-30 11:16:19,679::task::827::TaskManager.Task::(resourceAcquired) Task=`fc21b8a2-4f0f-42ce-9027-47ba55fb1ee0`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:16:19,679::task::990::TaskManager.Task::(_decref) Task=`fc21b8a2-4f0f-42ce-9027-47ba55fb1ee0`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:16:19,680::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013617029120', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:19,680::task::1185::TaskManager.Task::(prepare) Task=`fc21b8a2-4f0f-42ce-9027-47ba55fb1ee0`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013617029120', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:19,680::task::595::TaskManager.Task::(_updateState) Task=`fc21b8a2-4f0f-42ce-9027-47ba55fb1ee0`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:16:19,681::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:16:19,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:16:19,681::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:16:19,681::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:16:19,681::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:16:19,681::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:16:19,682::task::990::TaskManager.Task::(_decref) Task=`fc21b8a2-4f0f-42ce-9027-47ba55fb1ee0`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:19,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:19,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040269 s, 25.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:21,448::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:22,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:22,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376635 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:24,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:24,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453074 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:24,460::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:16:25,638::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:16:25,655::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473857 s, 864 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:26,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:26,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451979 s, 22.7 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:16:26,915::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:26,927::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000297604 s, 1.2 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:27,473::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:28,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:28,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037305 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:16:29,712::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [2e55ab46] >Thread-13::DEBUG::2014-03-30 11:16:29,712::task::595::TaskManager.Task::(_updateState) Task=`1b384753-2f41-4c31-8a38-3d023994f643`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:29,713::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:16:29,736::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:29,737::task::1185::TaskManager.Task::(prepare) Task=`1b384753-2f41-4c31-8a38-3d023994f643`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:29,737::task::595::TaskManager.Task::(_updateState) Task=`1b384753-2f41-4c31-8a38-3d023994f643`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:29,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:29,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:29,737::task::990::TaskManager.Task::(_decref) Task=`1b384753-2f41-4c31-8a38-3d023994f643`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:16:29,744::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [2e55ab46] >Thread-236::DEBUG::2014-03-30 11:16:29,744::task::595::TaskManager.Task::(_updateState) Task=`3207e2d5-8685-4dc8-bb8f-3f387e389386`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:16:29,744::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:16:29,745::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`54c745eb-aa38-442d-8908-a8bf55f3a67e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:16:29,745::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:16:29,745::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:16:29,746::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`54c745eb-aa38-442d-8908-a8bf55f3a67e`::Granted request >Thread-236::DEBUG::2014-03-30 11:16:29,746::task::827::TaskManager.Task::(resourceAcquired) Task=`3207e2d5-8685-4dc8-bb8f-3f387e389386`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:16:29,746::task::990::TaskManager.Task::(_decref) Task=`3207e2d5-8685-4dc8-bb8f-3f387e389386`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:16:29,747::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013617029120', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:29,748::task::1185::TaskManager.Task::(prepare) Task=`3207e2d5-8685-4dc8-bb8f-3f387e389386`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013617029120', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:29,748::task::595::TaskManager.Task::(_updateState) Task=`3207e2d5-8685-4dc8-bb8f-3f387e389386`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:16:29,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:16:29,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:16:29,749::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:16:29,749::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:16:29,749::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:16:29,749::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:16:29,749::task::990::TaskManager.Task::(_decref) Task=`3207e2d5-8685-4dc8-bb8f-3f387e389386`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:30,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:16:30,486::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:30,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374616 s, 27.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:16:31,998::task::595::TaskManager.Task::(_updateState) Task=`c623cf0b-3317-4b86-b1a7-5008e461f597`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:31,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:16:31,998::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473857', 'lastCheck': '6.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297604', 'lastCheck': '5.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:31,998::task::1185::TaskManager.Task::(prepare) Task=`c623cf0b-3317-4b86-b1a7-5008e461f597`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473857', 'lastCheck': '6.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000297604', 'lastCheck': '5.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:31,999::task::595::TaskManager.Task::(_updateState) Task=`c623cf0b-3317-4b86-b1a7-5008e461f597`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:31,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:31,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:31,999::task::990::TaskManager.Task::(_decref) Task=`c623cf0b-3317-4b86-b1a7-5008e461f597`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:32,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:32,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0829556 s, 12.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:33,497::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:34,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:34,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372013 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:16:35,664::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:16:35,682::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.004925 s, 832 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:36,509::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:36,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:36,975::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:36,987::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000339473 s, 1.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:37,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373419 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:39,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:39,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450224 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:39,522::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:16:39,784::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:16:39,785::task::595::TaskManager.Task::(_updateState) Task=`190410ac-eae5-467f-8d64-7cc8c258de71`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:39,785::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:16:40,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:40,097::task::1185::TaskManager.Task::(prepare) Task=`190410ac-eae5-467f-8d64-7cc8c258de71`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:40,097::task::595::TaskManager.Task::(_updateState) Task=`190410ac-eae5-467f-8d64-7cc8c258de71`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:40,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:40,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:40,098::task::990::TaskManager.Task::(_decref) Task=`190410ac-eae5-467f-8d64-7cc8c258de71`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:16:40,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:16:40,104::task::595::TaskManager.Task::(_updateState) Task=`51a49f91-4bba-46a4-b915-736b08945ff1`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:16:40,104::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:16:40,104::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`4ebd14ac-72c7-454e-a6eb-ad8a747c6628`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:16:40,105::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:16:40,105::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:16:40,105::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`4ebd14ac-72c7-454e-a6eb-ad8a747c6628`::Granted request >Thread-236::DEBUG::2014-03-30 11:16:40,105::task::827::TaskManager.Task::(resourceAcquired) Task=`51a49f91-4bba-46a4-b915-736b08945ff1`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:16:40,106::task::990::TaskManager.Task::(_decref) Task=`51a49f91-4bba-46a4-b915-736b08945ff1`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:16:40,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013617029120', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:40,107::task::1185::TaskManager.Task::(prepare) Task=`51a49f91-4bba-46a4-b915-736b08945ff1`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013617029120', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:40,107::task::595::TaskManager.Task::(_updateState) Task=`51a49f91-4bba-46a4-b915-736b08945ff1`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:16:40,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:16:40,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:16:40,107::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:16:40,108::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:16:40,108::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:16:40,108::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:16:40,108::task::990::TaskManager.Task::(_decref) Task=`51a49f91-4bba-46a4-b915-736b08945ff1`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:41,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:41,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.184034 s, 5.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:42,533::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:43,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:43,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374893 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:45,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:16:45,555::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:45,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374765 s, 27.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:16:45,691::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:16:45,713::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00834328 s, 491 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:16:47,000::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:47,012::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000421121 s, 822 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:16:47,157::task::595::TaskManager.Task::(_updateState) Task=`64313846-c676-49c3-bd0b-f1b9bcc8788c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:47,157::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:16:47,157::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00834328', 'lastCheck': '1.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421121', 'lastCheck': '0.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:47,157::task::1185::TaskManager.Task::(prepare) Task=`64313846-c676-49c3-bd0b-f1b9bcc8788c`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00834328', 'lastCheck': '1.4', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000421121', 'lastCheck': '0.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:16:47,158::task::595::TaskManager.Task::(_updateState) Task=`64313846-c676-49c3-bd0b-f1b9bcc8788c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:47,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:47,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:47,158::task::990::TaskManager.Task::(_decref) Task=`64313846-c676-49c3-bd0b-f1b9bcc8788c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:16:47,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:47,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452285 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:48,568::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:49,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:49,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374064 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:16:50,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:16:50,138::task::595::TaskManager.Task::(_updateState) Task=`4c86051b-0dff-4a73-a418-91358acf15a1`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:16:50,138::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:16:50,160::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:50,160::task::1185::TaskManager.Task::(prepare) Task=`4c86051b-0dff-4a73-a418-91358acf15a1`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:16:50,161::task::595::TaskManager.Task::(_updateState) Task=`4c86051b-0dff-4a73-a418-91358acf15a1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:16:50,161::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:16:50,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:16:50,161::task::990::TaskManager.Task::(_decref) Task=`4c86051b-0dff-4a73-a418-91358acf15a1`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:16:50,167::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:16:50,168::task::595::TaskManager.Task::(_updateState) Task=`554ec1d2-747a-4abf-9f41-f78278ddccf3`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:16:50,168::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:16:50,169::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ce926e16-fad6-4939-9ab3-7c870a79cffd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:16:50,169::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:16:50,169::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:16:50,169::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ce926e16-fad6-4939-9ab3-7c870a79cffd`::Granted request >Thread-236::DEBUG::2014-03-30 11:16:50,170::task::827::TaskManager.Task::(resourceAcquired) Task=`554ec1d2-747a-4abf-9f41-f78278ddccf3`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:16:50,170::task::990::TaskManager.Task::(_decref) Task=`554ec1d2-747a-4abf-9f41-f78278ddccf3`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:16:50,171::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:50,171::task::1185::TaskManager.Task::(prepare) Task=`554ec1d2-747a-4abf-9f41-f78278ddccf3`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:16:50,172::task::595::TaskManager.Task::(_updateState) Task=`554ec1d2-747a-4abf-9f41-f78278ddccf3`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:16:50,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:16:50,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:16:50,172::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:16:50,173::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:16:50,173::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:16:50,173::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:16:50,173::task::990::TaskManager.Task::(_decref) Task=`554ec1d2-747a-4abf-9f41-f78278ddccf3`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:16:51,578::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:51,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:51,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373647 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:54,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:54,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451151 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:54,590::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:16:55,722::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:16:55,744::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00891655 s, 459 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:16:56,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:56,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455788 s, 22.5 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:16:57,022::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:16:57,034::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000368981 s, 938 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:16:57,602::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:16:58,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:16:58,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391007 s, 26.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:17:00,198::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:17:00,199::task::595::TaskManager.Task::(_updateState) Task=`b47b453b-d298-4333-90c0-70d93fd33407`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:00,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:17:00,231::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:00,231::task::1185::TaskManager.Task::(prepare) Task=`b47b453b-d298-4333-90c0-70d93fd33407`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:00,231::task::595::TaskManager.Task::(_updateState) Task=`b47b453b-d298-4333-90c0-70d93fd33407`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:00,231::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:00,232::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:00,232::task::990::TaskManager.Task::(_decref) Task=`b47b453b-d298-4333-90c0-70d93fd33407`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:17:00,238::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:17:00,239::task::595::TaskManager.Task::(_updateState) Task=`06488e13-56c5-4f7c-8719-fe165d9826e7`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:17:00,239::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:17:00,240::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`d5729464-7fe7-4157-bd12-f4cd642fe7d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:17:00,240::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:17:00,240::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:17:00,240::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`d5729464-7fe7-4157-bd12-f4cd642fe7d6`::Granted request >Thread-236::DEBUG::2014-03-30 11:17:00,241::task::827::TaskManager.Task::(resourceAcquired) Task=`06488e13-56c5-4f7c-8719-fe165d9826e7`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:17:00,241::task::990::TaskManager.Task::(_decref) Task=`06488e13-56c5-4f7c-8719-fe165d9826e7`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:17:00,242::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:00,242::task::1185::TaskManager.Task::(prepare) Task=`06488e13-56c5-4f7c-8719-fe165d9826e7`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:00,243::task::595::TaskManager.Task::(_updateState) Task=`06488e13-56c5-4f7c-8719-fe165d9826e7`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:17:00,243::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:17:00,243::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:17:00,243::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:17:00,244::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:17:00,244::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:17:00,244::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:17:00,244::task::990::TaskManager.Task::(_decref) Task=`06488e13-56c5-4f7c-8719-fe165d9826e7`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:17:00,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:00,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491273 s, 20.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:00,615::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:17:02,316::task::595::TaskManager.Task::(_updateState) Task=`06ae63bd-cd35-4d85-a53d-55a86094dfdb`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:02,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:17:02,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00891655', 'lastCheck': '6.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368981', 'lastCheck': '5.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:02,317::task::1185::TaskManager.Task::(prepare) Task=`06ae63bd-cd35-4d85-a53d-55a86094dfdb`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00891655', 'lastCheck': '6.6', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368981', 'lastCheck': '5.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:02,317::task::595::TaskManager.Task::(_updateState) Task=`06ae63bd-cd35-4d85-a53d-55a86094dfdb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:02,317::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:02,317::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:02,317::task::990::TaskManager.Task::(_decref) Task=`06ae63bd-cd35-4d85-a53d-55a86094dfdb`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:17:02,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:02,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373788 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:03,630::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:04,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:04,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376972 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:17:05,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:17:05,774::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00905569 s, 452 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:06,641::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:06,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:06,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376391 s, 27.2 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:17:07,045::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:17:07,057::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000449832 s, 769 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:08,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:08,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0602757 s, 17.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:09,653::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:17:10,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [560c34c] >Thread-13::DEBUG::2014-03-30 11:17:10,273::task::595::TaskManager.Task::(_updateState) Task=`3e7b3204-2068-48d7-933a-8dfc2bf9bb98`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:10,273::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:17:10,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:10,298::task::1185::TaskManager.Task::(prepare) Task=`3e7b3204-2068-48d7-933a-8dfc2bf9bb98`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:10,299::task::595::TaskManager.Task::(_updateState) Task=`3e7b3204-2068-48d7-933a-8dfc2bf9bb98`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:10,299::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:10,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:10,299::task::990::TaskManager.Task::(_decref) Task=`3e7b3204-2068-48d7-933a-8dfc2bf9bb98`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:17:10,305::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [560c34c] >Thread-236::DEBUG::2014-03-30 11:17:10,305::task::595::TaskManager.Task::(_updateState) Task=`581296f6-d8b6-4f7b-af6e-bdd2d9386820`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:17:10,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:17:10,306::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ac6c2e15-a687-4916-893c-8c087457af68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:17:10,306::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:17:10,306::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:17:10,307::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ac6c2e15-a687-4916-893c-8c087457af68`::Granted request >Thread-236::DEBUG::2014-03-30 11:17:10,308::task::827::TaskManager.Task::(resourceAcquired) Task=`581296f6-d8b6-4f7b-af6e-bdd2d9386820`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:17:10,308::task::990::TaskManager.Task::(_decref) Task=`581296f6-d8b6-4f7b-af6e-bdd2d9386820`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:17:10,309::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:10,309::task::1185::TaskManager.Task::(prepare) Task=`581296f6-d8b6-4f7b-af6e-bdd2d9386820`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:10,309::task::595::TaskManager.Task::(_updateState) Task=`581296f6-d8b6-4f7b-af6e-bdd2d9386820`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:17:10,309::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:17:10,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:17:10,310::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:17:10,310::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:17:10,310::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:17:10,310::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:17:10,310::task::990::TaskManager.Task::(_decref) Task=`581296f6-d8b6-4f7b-af6e-bdd2d9386820`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:17:10,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:11,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053766 s, 19.0 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:12,665::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:13,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:13,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372669 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:15,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:15,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530806 s, 19.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:15,676::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:17:15,783::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:17:15,809::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0134691 s, 304 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:17:17,068::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:17:17,080::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000315272 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:17,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:17:17,477::task::595::TaskManager.Task::(_updateState) Task=`26c9d236-b109-440d-bb35-72c99b69221c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:17,481::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:17:17,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0134691', 'lastCheck': '1.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000315272', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:17,488::task::1185::TaskManager.Task::(prepare) Task=`26c9d236-b109-440d-bb35-72c99b69221c`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0134691', 'lastCheck': '1.7', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000315272', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:17,490::task::595::TaskManager.Task::(_updateState) Task=`26c9d236-b109-440d-bb35-72c99b69221c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:17,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:17,495::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:17,497::task::990::TaskManager.Task::(_decref) Task=`26c9d236-b109-440d-bb35-72c99b69221c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:17:17,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548491 s, 18.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:18,688::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:19,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:19,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549859 s, 18.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:17:20,335::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-13::DEBUG::2014-03-30 11:17:20,335::task::595::TaskManager.Task::(_updateState) Task=`53c6f0cf-5735-4b61-8bf7-afd4c8b7c2a2`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:20,336::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:17:20,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:20,361::task::1185::TaskManager.Task::(prepare) Task=`53c6f0cf-5735-4b61-8bf7-afd4c8b7c2a2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:20,361::task::595::TaskManager.Task::(_updateState) Task=`53c6f0cf-5735-4b61-8bf7-afd4c8b7c2a2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:20,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:20,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:20,362::task::990::TaskManager.Task::(_decref) Task=`53c6f0cf-5735-4b61-8bf7-afd4c8b7c2a2`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:17:20,368::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [1047f065] >Thread-236::DEBUG::2014-03-30 11:17:20,368::task::595::TaskManager.Task::(_updateState) Task=`c748710f-5f3a-4854-a161-cd5ab71ee6df`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:17:20,368::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:17:20,369::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6e08943f-9398-4dfb-b96e-fdeef72cda03`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:17:20,369::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:17:20,369::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:17:20,370::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`6e08943f-9398-4dfb-b96e-fdeef72cda03`::Granted request >Thread-236::DEBUG::2014-03-30 11:17:20,370::task::827::TaskManager.Task::(resourceAcquired) Task=`c748710f-5f3a-4854-a161-cd5ab71ee6df`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:17:20,370::task::990::TaskManager.Task::(_decref) Task=`c748710f-5f3a-4854-a161-cd5ab71ee6df`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:17:20,371::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:20,372::task::1185::TaskManager.Task::(prepare) Task=`c748710f-5f3a-4854-a161-cd5ab71ee6df`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:20,372::task::595::TaskManager.Task::(_updateState) Task=`c748710f-5f3a-4854-a161-cd5ab71ee6df`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:17:20,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:17:20,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:17:20,372::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:17:20,373::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:17:20,373::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:17:20,373::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:17:20,373::task::990::TaskManager.Task::(_decref) Task=`c748710f-5f3a-4854-a161-cd5ab71ee6df`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:17:21,701::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:21,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:21,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451937 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:23,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:23,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453042 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:24,715::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:17:25,817::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:17:25,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0174682 s, 234 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:25,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:26,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739549 s, 13.8 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:17:27,092::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:17:27,104::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00037746 s, 917 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:27,727::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:28,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:28,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372434 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:30,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:30,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526663 s, 19.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:17:30,403::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:17:30,403::task::595::TaskManager.Task::(_updateState) Task=`6baf84b6-dd9d-4dca-976d-d87053288b34`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:30,404::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:17:30,426::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:30,427::task::1185::TaskManager.Task::(prepare) Task=`6baf84b6-dd9d-4dca-976d-d87053288b34`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:30,427::task::595::TaskManager.Task::(_updateState) Task=`6baf84b6-dd9d-4dca-976d-d87053288b34`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:30,427::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:30,427::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:30,427::task::990::TaskManager.Task::(_decref) Task=`6baf84b6-dd9d-4dca-976d-d87053288b34`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:17:30,434::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:17:30,434::task::595::TaskManager.Task::(_updateState) Task=`2cf2ee1d-6d24-4cce-8a60-17b2e15ab9b9`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:17:30,434::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:17:30,435::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`15939e67-3c88-4412-95b7-2e1734fe30b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:17:30,435::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:17:30,435::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:17:30,436::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`15939e67-3c88-4412-95b7-2e1734fe30b7`::Granted request >Thread-236::DEBUG::2014-03-30 11:17:30,436::task::827::TaskManager.Task::(resourceAcquired) Task=`2cf2ee1d-6d24-4cce-8a60-17b2e15ab9b9`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:17:30,436::task::990::TaskManager.Task::(_decref) Task=`2cf2ee1d-6d24-4cce-8a60-17b2e15ab9b9`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:17:30,437::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:30,438::task::1185::TaskManager.Task::(prepare) Task=`2cf2ee1d-6d24-4cce-8a60-17b2e15ab9b9`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621321728', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:30,438::task::595::TaskManager.Task::(_updateState) Task=`2cf2ee1d-6d24-4cce-8a60-17b2e15ab9b9`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:17:30,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:17:30,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:17:30,439::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:17:30,439::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:17:30,439::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:17:30,439::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:17:30,439::task::990::TaskManager.Task::(_decref) Task=`2cf2ee1d-6d24-4cce-8a60-17b2e15ab9b9`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:17:30,738::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:32,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:32,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045491 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:17:32,973::task::595::TaskManager.Task::(_updateState) Task=`cc09026e-a1cb-4377-9451-4099e02f6bc3`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:32,973::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:17:32,973::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0174682', 'lastCheck': '7.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00037746', 'lastCheck': '5.9', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:32,974::task::1185::TaskManager.Task::(prepare) Task=`cc09026e-a1cb-4377-9451-4099e02f6bc3`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0174682', 'lastCheck': '7.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00037746', 'lastCheck': '5.9', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:32,974::task::595::TaskManager.Task::(_updateState) Task=`cc09026e-a1cb-4377-9451-4099e02f6bc3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:32,974::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:32,974::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:32,975::task::990::TaskManager.Task::(_decref) Task=`cc09026e-a1cb-4377-9451-4099e02f6bc3`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:17:33,749::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:34,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:34,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374758 s, 27.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:17:35,856::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:17:35,874::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00504174 s, 812 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:36,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:36,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374971 s, 27.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:36,761::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:17:37,114::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:17:37,126::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000453315 s, 763 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:38,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:38,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462819 s, 22.1 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:39,775::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:17:40,464::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:17:40,465::task::595::TaskManager.Task::(_updateState) Task=`0e9a1853-cbc3-4fc2-889d-7ed25cc9d322`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:40,465::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:17:40,517::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:40,517::task::1185::TaskManager.Task::(prepare) Task=`0e9a1853-cbc3-4fc2-889d-7ed25cc9d322`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:40,518::task::595::TaskManager.Task::(_updateState) Task=`0e9a1853-cbc3-4fc2-889d-7ed25cc9d322`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:40,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:40,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:40,518::task::990::TaskManager.Task::(_decref) Task=`0e9a1853-cbc3-4fc2-889d-7ed25cc9d322`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:17:40,523::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:17:40,523::task::595::TaskManager.Task::(_updateState) Task=`a0da3d3b-f22c-49d5-9759-f0c0f7755c05`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:17:40,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:17:40,524::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`a02cc505-2068-4e35-8ecd-5b83d1a06906`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:17:40,524::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:17:40,524::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:17:40,525::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`a02cc505-2068-4e35-8ecd-5b83d1a06906`::Granted request >Thread-236::DEBUG::2014-03-30 11:17:40,525::task::827::TaskManager.Task::(resourceAcquired) Task=`a0da3d3b-f22c-49d5-9759-f0c0f7755c05`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:17:40,525::task::990::TaskManager.Task::(_decref) Task=`a0da3d3b-f22c-49d5-9759-f0c0f7755c05`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:17:40,526::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621256192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:40,526::task::1185::TaskManager.Task::(prepare) Task=`a0da3d3b-f22c-49d5-9759-f0c0f7755c05`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013621256192', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:40,526::task::595::TaskManager.Task::(_updateState) Task=`a0da3d3b-f22c-49d5-9759-f0c0f7755c05`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:17:40,527::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:17:40,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:17:40,527::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:17:40,527::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:17:40,527::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:17:40,527::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:17:40,528::task::990::TaskManager.Task::(_decref) Task=`a0da3d3b-f22c-49d5-9759-f0c0f7755c05`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:17:40,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:40,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454253 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:42,787::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:42,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:43,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373504 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:45,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:45,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454282 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:45,797::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:17:45,882::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:17:45,909::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0136925 s, 299 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:17:47,137::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:17:47,148::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000368473 s, 939 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:17:47,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:47,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456754 s, 22.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:17:48,117::task::595::TaskManager.Task::(_updateState) Task=`098e06f2-0c8c-4d70-a9c0-3030ea51fe6c`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:48,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:17:48,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0136925', 'lastCheck': '2.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368473', 'lastCheck': '1.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:48,118::task::1185::TaskManager.Task::(prepare) Task=`098e06f2-0c8c-4d70-a9c0-3030ea51fe6c`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0136925', 'lastCheck': '2.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000368473', 'lastCheck': '1.0', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:17:48,118::task::595::TaskManager.Task::(_updateState) Task=`098e06f2-0c8c-4d70-a9c0-3030ea51fe6c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:48,119::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:48,119::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:48,119::task::990::TaskManager.Task::(_decref) Task=`098e06f2-0c8c-4d70-a9c0-3030ea51fe6c`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:17:48,808::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:49,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:49,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373996 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:17:50,555::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4ed70837] >Thread-13::DEBUG::2014-03-30 11:17:50,556::task::595::TaskManager.Task::(_updateState) Task=`accfeb09-e1c7-487c-a05d-cb8fb35a95d0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:17:50,556::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:17:50,593::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:50,593::task::1185::TaskManager.Task::(prepare) Task=`accfeb09-e1c7-487c-a05d-cb8fb35a95d0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:17:50,593::task::595::TaskManager.Task::(_updateState) Task=`accfeb09-e1c7-487c-a05d-cb8fb35a95d0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:17:50,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:17:50,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:17:50,594::task::990::TaskManager.Task::(_decref) Task=`accfeb09-e1c7-487c-a05d-cb8fb35a95d0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:17:50,601::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4ed70837] >Thread-236::DEBUG::2014-03-30 11:17:50,601::task::595::TaskManager.Task::(_updateState) Task=`e9d152ac-1819-4fdc-85f8-edad0e041651`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:17:50,602::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:17:50,602::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`d95ccbcb-93c2-4513-8938-975b0ea703b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:17:50,602::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:17:50,603::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:17:50,603::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`d95ccbcb-93c2-4513-8938-975b0ea703b0`::Granted request >Thread-236::DEBUG::2014-03-30 11:17:50,603::task::827::TaskManager.Task::(resourceAcquired) Task=`e9d152ac-1819-4fdc-85f8-edad0e041651`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:17:50,604::task::990::TaskManager.Task::(_decref) Task=`e9d152ac-1819-4fdc-85f8-edad0e041651`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:17:50,605::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619126272', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:50,605::task::1185::TaskManager.Task::(prepare) Task=`e9d152ac-1819-4fdc-85f8-edad0e041651`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619126272', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:17:50,605::task::595::TaskManager.Task::(_updateState) Task=`e9d152ac-1819-4fdc-85f8-edad0e041651`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:17:50,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:17:50,606::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:17:50,606::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:17:50,606::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:17:50,606::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:17:50,607::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:17:50,607::task::990::TaskManager.Task::(_decref) Task=`e9d152ac-1819-4fdc-85f8-edad0e041651`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:17:51,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:51,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452603 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:51,820::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:53,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:53,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.04544 s, 22.5 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:54,831::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:55,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:55,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464556 s, 22.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:17:55,931::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:17:55,963::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123439 s, 332 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:17:57,158::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:17:57,170::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000466729 s, 741 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:17:57,845::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:17:57,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:17:58,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373438 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:00,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:00,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456027 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:00,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [873f829] >Thread-13::DEBUG::2014-03-30 11:18:00,635::task::595::TaskManager.Task::(_updateState) Task=`3220bae8-f37b-4f34-b4cf-0532ed5b2f05`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:00,635::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:18:00,659::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:00,659::task::1185::TaskManager.Task::(prepare) Task=`3220bae8-f37b-4f34-b4cf-0532ed5b2f05`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:00,660::task::595::TaskManager.Task::(_updateState) Task=`3220bae8-f37b-4f34-b4cf-0532ed5b2f05`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:00,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:00,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:00,660::task::990::TaskManager.Task::(_decref) Task=`3220bae8-f37b-4f34-b4cf-0532ed5b2f05`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:18:00,667::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [873f829] >Thread-236::DEBUG::2014-03-30 11:18:00,667::task::595::TaskManager.Task::(_updateState) Task=`fecd3aa7-ca12-464f-8ecb-7609e746d4cd`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:18:00,667::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:18:00,668::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9d093462-c35e-4f18-929d-569a5fcdf36c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:18:00,668::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:18:00,668::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:18:00,668::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`9d093462-c35e-4f18-929d-569a5fcdf36c`::Granted request >Thread-236::DEBUG::2014-03-30 11:18:00,669::task::827::TaskManager.Task::(resourceAcquired) Task=`fecd3aa7-ca12-464f-8ecb-7609e746d4cd`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:18:00,669::task::990::TaskManager.Task::(_decref) Task=`fecd3aa7-ca12-464f-8ecb-7609e746d4cd`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:18:00,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619126272', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:00,670::task::1185::TaskManager.Task::(prepare) Task=`fecd3aa7-ca12-464f-8ecb-7609e746d4cd`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619126272', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:00,670::task::595::TaskManager.Task::(_updateState) Task=`fecd3aa7-ca12-464f-8ecb-7609e746d4cd`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:18:00,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:18:00,671::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:18:00,671::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:18:00,671::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:18:00,671::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:18:00,671::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:18:00,671::task::990::TaskManager.Task::(_decref) Task=`fecd3aa7-ca12-464f-8ecb-7609e746d4cd`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:00,858::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:02,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:02,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455585 s, 22.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:03,304::task::595::TaskManager.Task::(_updateState) Task=`41774cc8-23fb-43aa-8d3a-f15c9e793a71`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:03,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:18:03,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0123439', 'lastCheck': '7.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000466729', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:03,306::task::1185::TaskManager.Task::(prepare) Task=`41774cc8-23fb-43aa-8d3a-f15c9e793a71`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0123439', 'lastCheck': '7.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000466729', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:03,306::task::595::TaskManager.Task::(_updateState) Task=`41774cc8-23fb-43aa-8d3a-f15c9e793a71`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:03,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:03,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:03,307::task::990::TaskManager.Task::(_decref) Task=`41774cc8-23fb-43aa-8d3a-f15c9e793a71`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:03,869::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:04,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:04,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037311 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:18:05,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:05,998::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.013262 s, 309 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:06,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:06,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452264 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:06,881::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:18:07,179::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:07,191::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000444094 s, 779 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:08,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:08,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456556 s, 22.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:09,892::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:10,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:18:10,698::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:18:10,700::task::595::TaskManager.Task::(_updateState) Task=`e2799a15-e91b-4ed8-8edd-e747fa23ad88`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:10,701::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:18:10,726::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:10,727::task::1185::TaskManager.Task::(prepare) Task=`e2799a15-e91b-4ed8-8edd-e747fa23ad88`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:10,728::task::595::TaskManager.Task::(_updateState) Task=`e2799a15-e91b-4ed8-8edd-e747fa23ad88`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:10,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:10,731::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:10,737::task::990::TaskManager.Task::(_decref) Task=`e2799a15-e91b-4ed8-8edd-e747fa23ad88`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:18:10,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:18:10,755::task::595::TaskManager.Task::(_updateState) Task=`a0d29c4e-0d60-40a0-9b7b-09d740eead7c`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:18:10,758::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:18:10,761::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ce01d47c-4e94-427e-8742-365ef69224d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:18:10,762::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:18:10,764::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:18:10,765::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`ce01d47c-4e94-427e-8742-365ef69224d3`::Granted request >Thread-236::DEBUG::2014-03-30 11:18:10,767::task::827::TaskManager.Task::(resourceAcquired) Task=`a0d29c4e-0d60-40a0-9b7b-09d740eead7c`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:18:10,769::task::990::TaskManager.Task::(_decref) Task=`a0d29c4e-0d60-40a0-9b7b-09d740eead7c`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:18:10,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619126272', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:10,776::task::1185::TaskManager.Task::(prepare) Task=`a0d29c4e-0d60-40a0-9b7b-09d740eead7c`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619126272', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:10,777::task::595::TaskManager.Task::(_updateState) Task=`a0d29c4e-0d60-40a0-9b7b-09d740eead7c`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:18:10,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:18:10,779::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:18:10,781::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:18:10,783::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:18:10,784::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:18:10,785::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:18:10,787::task::990::TaskManager.Task::(_decref) Task=`a0d29c4e-0d60-40a0-9b7b-09d740eead7c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:18:10,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432184 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:12,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >BindingXMLRPC::ERROR::2014-03-30 11:18:12,906::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:12,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372867 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:14,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:15,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451623 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:15,925::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:18:16,003::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:18:16,003::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::ERROR::2014-03-30 11:18:16,003::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain dcfe3432-59a5-4a2f-b358-6d91f31b3e62 >Thread-14::DEBUG::2014-03-30 11:18:16,004::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:18:16,007::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:16,030::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0120933 s, 169 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:18:16,031::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0120933 s, 169 kB/s'], size: 2048 >Thread-14::DEBUG::2014-03-30 11:18:16,031::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-03-30 11:18:16,031::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-03-30 11:18:16,031::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-03-30 11:18:16,032::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:18:16,032::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:18:16,032::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:18:16,032::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:18:16,033::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-03-30 11:18:16,034::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000567e404977a4e311|/dev/mapper/360060160f4a03000da2233488fa4e311|/dev/mapper/360060160f4a03000e86588568fa4e311|/dev/mapper/360060160f4a03000f8d72cd38ca4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:16,367::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:18:16,368::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-03-30 11:18:16,369::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=wxY9cX-001T-eqwx-zf7D-Yhcl-2Uwh-KUR3m6', 'LOCKPOLICY=', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', u'PV0=pv:360060160f4a03000da2233488fa4e311,uuid:Qj89Z4-DLwY-sR5F-gGtn-bLRy-SNKX-2ho7ew,pestart:0,pecount:557,mapoffset:0', 'LEASERETRIES=3', 'SDUUID=dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'CLASS=Data', 'DESCRIPTION=Imp_Exp_DC0_data_domain0', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Imp_Exp_DC0', 'ROLE=Master', 'POOL_UUID=ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', u'POOL_DOMAINS=dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=2', '_SHA_CKSUM=db97a5e6891143b5e26a4bf2aacf0ba3b85f20a6'] >Thread-14::INFO::2014-03-30 11:18:16,370::sd::375::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_imageNS already registered >Thread-14::INFO::2014-03-30 11:18:16,370::sd::383::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_volumeNS already registered >Thread-14::INFO::2014-03-30 11:18:16,370::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace dcfe3432-59a5-4a2f-b358-6d91f31b3e62_lvmActivationNS already registered >Thread-14::DEBUG::2014-03-30 11:18:16,371::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160f4a03000da2233488fa4e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " dcfe3432-59a5-4a2f-b358-6d91f31b3e62' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:16,535::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:18:16,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:16,563::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00974751 s, 420 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:17,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:17,203::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:17,215::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00041821 s, 827 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:18,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.957263 s, 1.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:18,467::task::595::TaskManager.Task::(_updateState) Task=`7330207d-8c01-4d5b-b428-11831b4dd5ad`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:18,468::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:18:18,468::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00974751', 'lastCheck': '1.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041821', 'lastCheck': '1.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:18,468::task::1185::TaskManager.Task::(prepare) Task=`7330207d-8c01-4d5b-b428-11831b4dd5ad`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00974751', 'lastCheck': '1.9', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.00041821', 'lastCheck': '1.3', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:18,469::task::595::TaskManager.Task::(_updateState) Task=`7330207d-8c01-4d5b-b428-11831b4dd5ad`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:18,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:18,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:18,469::task::990::TaskManager.Task::(_decref) Task=`7330207d-8c01-4d5b-b428-11831b4dd5ad`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:18,936::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:20,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:20,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370324 s, 27.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:20,817::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:18:20,818::task::595::TaskManager.Task::(_updateState) Task=`39b11b70-a81e-4ebd-b6e4-9f38067be775`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:20,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:18:20,844::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:20,845::task::1185::TaskManager.Task::(prepare) Task=`39b11b70-a81e-4ebd-b6e4-9f38067be775`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:20,845::task::595::TaskManager.Task::(_updateState) Task=`39b11b70-a81e-4ebd-b6e4-9f38067be775`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:20,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:20,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:20,846::task::990::TaskManager.Task::(_decref) Task=`39b11b70-a81e-4ebd-b6e4-9f38067be775`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:18:20,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:18:20,852::task::595::TaskManager.Task::(_updateState) Task=`b9638efd-44bf-444f-a7ba-a83450696a31`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:18:20,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:18:20,854::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bd861317-cd70-4845-b1f0-ebf75c8dc9ed`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:18:20,854::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:18:20,854::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:18:20,855::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bd861317-cd70-4845-b1f0-ebf75c8dc9ed`::Granted request >Thread-236::DEBUG::2014-03-30 11:18:20,855::task::827::TaskManager.Task::(resourceAcquired) Task=`b9638efd-44bf-444f-a7ba-a83450696a31`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:18:20,855::task::990::TaskManager.Task::(_decref) Task=`b9638efd-44bf-444f-a7ba-a83450696a31`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:18:20,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619093504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:20,857::task::1185::TaskManager.Task::(prepare) Task=`b9638efd-44bf-444f-a7ba-a83450696a31`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619093504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:20,857::task::595::TaskManager.Task::(_updateState) Task=`b9638efd-44bf-444f-a7ba-a83450696a31`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:18:20,857::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:18:20,857::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:18:20,858::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:18:20,858::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:18:20,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:18:20,858::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:18:20,858::task::990::TaskManager.Task::(_decref) Task=`b9638efd-44bf-444f-a7ba-a83450696a31`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:21,947::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:22,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:22,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371821 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:24,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:24,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449403 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:24,959::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:26,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:26,590::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:26,606::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00263583 s, 1.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:26,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457096 s, 22.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:18:27,227::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:27,240::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000444533 s, 778 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:27,969::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:28,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:28,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372955 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:30,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:18:30,887::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:18:30,893::task::595::TaskManager.Task::(_updateState) Task=`bfed2fcc-c42e-4f69-a0be-ddd3d3ba144e`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:30,896::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Dummy-36::DEBUG::2014-03-30 11:18:30,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372609 s, 27.5 MB/s\n'; <rc> = 0 >Thread-13::INFO::2014-03-30 11:18:30,942::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:30,942::task::1185::TaskManager.Task::(prepare) Task=`bfed2fcc-c42e-4f69-a0be-ddd3d3ba144e`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:30,942::task::595::TaskManager.Task::(_updateState) Task=`bfed2fcc-c42e-4f69-a0be-ddd3d3ba144e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:30,942::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:30,942::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:30,943::task::990::TaskManager.Task::(_decref) Task=`bfed2fcc-c42e-4f69-a0be-ddd3d3ba144e`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:18:30,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:18:30,948::task::595::TaskManager.Task::(_updateState) Task=`ca37947a-b0ee-429c-b226-3f1b07beb446`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:18:30,948::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:18:30,949::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`41d11fa5-10d4-4437-b59f-f5023f77a5c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:18:30,949::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:18:30,950::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:18:30,950::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`41d11fa5-10d4-4437-b59f-f5023f77a5c5`::Granted request >Thread-236::DEBUG::2014-03-30 11:18:30,950::task::827::TaskManager.Task::(resourceAcquired) Task=`ca37947a-b0ee-429c-b226-3f1b07beb446`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:18:30,950::task::990::TaskManager.Task::(_decref) Task=`ca37947a-b0ee-429c-b226-3f1b07beb446`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:18:30,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619093504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:30,952::task::1185::TaskManager.Task::(prepare) Task=`ca37947a-b0ee-429c-b226-3f1b07beb446`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013619093504', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:30,952::task::595::TaskManager.Task::(_updateState) Task=`ca37947a-b0ee-429c-b226-3f1b07beb446`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:18:30,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:18:30,952::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:18:30,953::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:18:30,953::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:18:30,953::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:18:30,953::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:18:30,954::task::990::TaskManager.Task::(_decref) Task=`ca37947a-b0ee-429c-b226-3f1b07beb446`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:30,981::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:32,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:33,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459538 s, 22.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:33,612::task::595::TaskManager.Task::(_updateState) Task=`0a30485d-54f7-43ba-bc37-e68a4a2afa86`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:33,612::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:18:33,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00263583', 'lastCheck': '7.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444533', 'lastCheck': '6.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:33,613::task::1185::TaskManager.Task::(prepare) Task=`0a30485d-54f7-43ba-bc37-e68a4a2afa86`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00263583', 'lastCheck': '7.0', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000444533', 'lastCheck': '6.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:33,613::task::595::TaskManager.Task::(_updateState) Task=`0a30485d-54f7-43ba-bc37-e68a4a2afa86`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:33,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:33,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:33,614::task::990::TaskManager.Task::(_decref) Task=`0a30485d-54f7-43ba-bc37-e68a4a2afa86`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:33,994::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:35,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:35,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037627 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:18:36,620::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:36,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00768968 s, 533 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:37,005::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:37,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:37,321::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:37,355::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000430307 s, 804 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:37,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.162518 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:39,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:39,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045268 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:40,016::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:18:40,992::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:18:40,993::task::595::TaskManager.Task::(_updateState) Task=`76133c78-c88e-4a83-a59b-037bfe93eef6`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:40,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:18:41,017::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:41,017::task::1185::TaskManager.Task::(prepare) Task=`76133c78-c88e-4a83-a59b-037bfe93eef6`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:41,017::task::595::TaskManager.Task::(_updateState) Task=`76133c78-c88e-4a83-a59b-037bfe93eef6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:41,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:41,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:41,018::task::990::TaskManager.Task::(_decref) Task=`76133c78-c88e-4a83-a59b-037bfe93eef6`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:18:41,024::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:18:41,024::task::595::TaskManager.Task::(_updateState) Task=`26ecce39-06a9-4509-afed-649a34bd8049`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:18:41,024::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:18:41,025::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b9b0a2d9-5c23-4355-9d38-e5c3c7c19c3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:18:41,025::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:18:41,026::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:18:41,026::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b9b0a2d9-5c23-4355-9d38-e5c3c7c19c3d`::Granted request >Thread-236::DEBUG::2014-03-30 11:18:41,026::task::827::TaskManager.Task::(resourceAcquired) Task=`26ecce39-06a9-4509-afed-649a34bd8049`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:18:41,026::task::990::TaskManager.Task::(_decref) Task=`26ecce39-06a9-4509-afed-649a34bd8049`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:18:41,028::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:41,028::task::1185::TaskManager.Task::(prepare) Task=`26ecce39-06a9-4509-afed-649a34bd8049`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:41,028::task::595::TaskManager.Task::(_updateState) Task=`26ecce39-06a9-4509-afed-649a34bd8049`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:18:41,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:18:41,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:18:41,029::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:18:41,029::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:18:41,029::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:18:41,029::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:18:41,030::task::990::TaskManager.Task::(_decref) Task=`26ecce39-06a9-4509-afed-649a34bd8049`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:18:41,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:41,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450121 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:43,028::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:43,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:43,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371118 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:45,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:45,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373842 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:46,039::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:18:46,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:46,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00949607 s, 431 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:18:47,376::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:47,388::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000431691 s, 801 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:47,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:48,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.338835 s, 3.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:48,761::task::595::TaskManager.Task::(_updateState) Task=`e6948854-796f-4f5c-929f-3773e7448ace`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:48,761::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:18:48,761::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00949607', 'lastCheck': '2.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431691', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:48,761::task::1185::TaskManager.Task::(prepare) Task=`e6948854-796f-4f5c-929f-3773e7448ace`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00949607', 'lastCheck': '2.1', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000431691', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:18:48,762::task::595::TaskManager.Task::(_updateState) Task=`e6948854-796f-4f5c-929f-3773e7448ace`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:48,762::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:48,762::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:48,762::task::990::TaskManager.Task::(_decref) Task=`e6948854-796f-4f5c-929f-3773e7448ace`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:49,050::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:50,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:50,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374046 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:18:51,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:18:51,059::task::595::TaskManager.Task::(_updateState) Task=`cde65d1a-5554-468d-8f71-af785d0673e0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:18:51,060::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:18:51,086::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:51,086::task::1185::TaskManager.Task::(prepare) Task=`cde65d1a-5554-468d-8f71-af785d0673e0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:18:51,086::task::595::TaskManager.Task::(_updateState) Task=`cde65d1a-5554-468d-8f71-af785d0673e0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:18:51,086::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:18:51,087::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:18:51,087::task::990::TaskManager.Task::(_decref) Task=`cde65d1a-5554-468d-8f71-af785d0673e0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:18:51,093::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:18:51,094::task::595::TaskManager.Task::(_updateState) Task=`a33fb05d-e991-420c-adf6-3bf60404f1bb`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:18:51,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:18:51,094::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`786476d1-bec4-46e7-a44a-50262a1b1e13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:18:51,095::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:18:51,095::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:18:51,095::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`786476d1-bec4-46e7-a44a-50262a1b1e13`::Granted request >Thread-236::DEBUG::2014-03-30 11:18:51,096::task::827::TaskManager.Task::(resourceAcquired) Task=`a33fb05d-e991-420c-adf6-3bf60404f1bb`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:18:51,096::task::990::TaskManager.Task::(_decref) Task=`a33fb05d-e991-420c-adf6-3bf60404f1bb`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:18:51,097::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:51,097::task::1185::TaskManager.Task::(prepare) Task=`a33fb05d-e991-420c-adf6-3bf60404f1bb`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:18:51,097::task::595::TaskManager.Task::(_updateState) Task=`a33fb05d-e991-420c-adf6-3bf60404f1bb`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:18:51,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:18:51,098::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:18:51,098::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:18:51,098::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:18:51,099::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:18:51,099::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:18:51,099::task::990::TaskManager.Task::(_decref) Task=`a33fb05d-e991-420c-adf6-3bf60404f1bb`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:18:52,067::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:52,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:52,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444374 s, 23.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:54,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:54,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373094 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:55,078::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:18:56,680::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:56,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-03-30 11:18:56,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00473757 s, 865 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:18:56,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459159 s, 22.3 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:18:57,399::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:18:57,410::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000453249 s, 763 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:18:58,090::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:18:58,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:18:58,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374737 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:00,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:01,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371659 s, 27.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:01,102::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:19:01,125::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4b2a6040] >Thread-13::DEBUG::2014-03-30 11:19:01,126::task::595::TaskManager.Task::(_updateState) Task=`c1c1979d-d599-42d8-bded-8fb53bdf9101`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:01,126::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:19:01,152::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:01,153::task::1185::TaskManager.Task::(prepare) Task=`c1c1979d-d599-42d8-bded-8fb53bdf9101`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:01,153::task::595::TaskManager.Task::(_updateState) Task=`c1c1979d-d599-42d8-bded-8fb53bdf9101`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:01,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:01,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:01,153::task::990::TaskManager.Task::(_decref) Task=`c1c1979d-d599-42d8-bded-8fb53bdf9101`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:19:01,160::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [4b2a6040] >Thread-236::DEBUG::2014-03-30 11:19:01,160::task::595::TaskManager.Task::(_updateState) Task=`3ce68f38-57a9-47a9-86cb-fe37dabffcb8`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:19:01,160::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:19:01,161::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`f16f2b8b-3098-4d6e-a379-803ee3501698`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:19:01,161::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:19:01,161::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:19:01,162::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`f16f2b8b-3098-4d6e-a379-803ee3501698`::Granted request >Thread-236::DEBUG::2014-03-30 11:19:01,162::task::827::TaskManager.Task::(resourceAcquired) Task=`3ce68f38-57a9-47a9-86cb-fe37dabffcb8`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:19:01,162::task::990::TaskManager.Task::(_decref) Task=`3ce68f38-57a9-47a9-86cb-fe37dabffcb8`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:19:01,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:01,164::task::1185::TaskManager.Task::(prepare) Task=`3ce68f38-57a9-47a9-86cb-fe37dabffcb8`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:01,164::task::595::TaskManager.Task::(_updateState) Task=`3ce68f38-57a9-47a9-86cb-fe37dabffcb8`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:19:01,164::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:19:01,164::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:19:01,165::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:19:01,165::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:19:01,165::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:19:01,165::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:19:01,165::task::990::TaskManager.Task::(_decref) Task=`3ce68f38-57a9-47a9-86cb-fe37dabffcb8`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:19:03,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:03,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0466377 s, 22.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:19:03,938::task::595::TaskManager.Task::(_updateState) Task=`2ad925b7-e427-48c8-8a19-c743e2fc6af4`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:03,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:19:03,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473757', 'lastCheck': '7.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453249', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:19:03,939::task::1185::TaskManager.Task::(prepare) Task=`2ad925b7-e427-48c8-8a19-c743e2fc6af4`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00473757', 'lastCheck': '7.2', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000453249', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:19:03,939::task::595::TaskManager.Task::(_updateState) Task=`2ad925b7-e427-48c8-8a19-c743e2fc6af4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:03,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:03,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:03,940::task::990::TaskManager.Task::(_decref) Task=`2ad925b7-e427-48c8-8a19-c743e2fc6af4`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:19:04,127::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:05,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:05,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372194 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:19:06,718::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:19:06,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00543314 s, 754 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:07,140::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:07,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-15::DEBUG::2014-03-30 11:19:07,505::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:19:07,540::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.00052237 s, 662 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:07,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044953 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:09,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:09,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373153 s, 27.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:10,152::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:19:11,191::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:19:11,192::task::595::TaskManager.Task::(_updateState) Task=`f63dbf94-486d-4dca-9fd7-5f5606d1d259`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:11,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:19:11,222::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:11,223::task::1185::TaskManager.Task::(prepare) Task=`f63dbf94-486d-4dca-9fd7-5f5606d1d259`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:11,223::task::595::TaskManager.Task::(_updateState) Task=`f63dbf94-486d-4dca-9fd7-5f5606d1d259`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:11,223::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:11,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:11,224::task::990::TaskManager.Task::(_decref) Task=`f63dbf94-486d-4dca-9fd7-5f5606d1d259`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:19:11,229::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:19:11,229::task::595::TaskManager.Task::(_updateState) Task=`c814b892-5c61-4b63-aafc-3ed97b8b22e6`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:19:11,230::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:19:11,230::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`afad749a-6641-4ca5-8a80-4babc1ba84b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:19:11,231::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:19:11,231::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:19:11,231::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`afad749a-6641-4ca5-8a80-4babc1ba84b9`::Granted request >Thread-236::DEBUG::2014-03-30 11:19:11,232::task::827::TaskManager.Task::(resourceAcquired) Task=`c814b892-5c61-4b63-aafc-3ed97b8b22e6`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:19:11,232::task::990::TaskManager.Task::(_decref) Task=`c814b892-5c61-4b63-aafc-3ed97b8b22e6`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:19:11,233::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:11,233::task::1185::TaskManager.Task::(prepare) Task=`c814b892-5c61-4b63-aafc-3ed97b8b22e6`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013616996352', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:11,233::task::595::TaskManager.Task::(_updateState) Task=`c814b892-5c61-4b63-aafc-3ed97b8b22e6`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:19:11,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:19:11,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:19:11,234::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:19:11,234::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:19:11,234::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:19:11,235::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:19:11,235::task::990::TaskManager.Task::(_decref) Task=`c814b892-5c61-4b63-aafc-3ed97b8b22e6`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:19:11,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:11,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451272 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:13,164::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:13,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:13,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376601 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:15,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:16,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370344 s, 27.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:16,176::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-14::DEBUG::2014-03-30 11:19:16,745::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:19:16,767::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00942757 s, 434 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:19:17,560::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:19:17,572::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000439814 s, 787 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:18,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:18,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457215 s, 22.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:19:19,101::task::595::TaskManager.Task::(_updateState) Task=`e8588b5f-d87a-48e2-9c72-d926eccda0ea`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:19,101::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:19:19,102::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00942757', 'lastCheck': '2.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439814', 'lastCheck': '1.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:19:19,102::task::1185::TaskManager.Task::(prepare) Task=`e8588b5f-d87a-48e2-9c72-d926eccda0ea`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00942757', 'lastCheck': '2.3', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000439814', 'lastCheck': '1.5', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:19:19,102::task::595::TaskManager.Task::(_updateState) Task=`e8588b5f-d87a-48e2-9c72-d926eccda0ea`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:19,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:19,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:19,103::task::990::TaskManager.Task::(_decref) Task=`e8588b5f-d87a-48e2-9c72-d926eccda0ea`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:19:19,186::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:20,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:20,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388404 s, 26.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-03-30 11:19:21,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-13::DEBUG::2014-03-30 11:19:21,260::task::595::TaskManager.Task::(_updateState) Task=`c0c03a41-bea6-4174-b406-7d1187d0abc2`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:21,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:19:21,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:21,285::task::1185::TaskManager.Task::(prepare) Task=`c0c03a41-bea6-4174-b406-7d1187d0abc2`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:21,285::task::595::TaskManager.Task::(_updateState) Task=`c0c03a41-bea6-4174-b406-7d1187d0abc2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:21,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:21,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:21,285::task::990::TaskManager.Task::(_decref) Task=`c0c03a41-bea6-4174-b406-7d1187d0abc2`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:19:21,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [23ceb10a] >Thread-236::DEBUG::2014-03-30 11:19:21,291::task::595::TaskManager.Task::(_updateState) Task=`27cda6e0-d21e-4143-af3f-9fe0a643dcd1`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:19:21,291::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:19:21,292::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b28c92dc-84e3-440c-94b1-ac9aff05a381`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:19:21,292::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:19:21,292::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:19:21,293::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`b28c92dc-84e3-440c-94b1-ac9aff05a381`::Granted request >Thread-236::DEBUG::2014-03-30 11:19:21,293::task::827::TaskManager.Task::(resourceAcquired) Task=`27cda6e0-d21e-4143-af3f-9fe0a643dcd1`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:19:21,293::task::990::TaskManager.Task::(_decref) Task=`27cda6e0-d21e-4143-af3f-9fe0a643dcd1`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:19:21,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615685632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:21,295::task::1185::TaskManager.Task::(prepare) Task=`27cda6e0-d21e-4143-af3f-9fe0a643dcd1`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615685632', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:21,295::task::595::TaskManager.Task::(_updateState) Task=`27cda6e0-d21e-4143-af3f-9fe0a643dcd1`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:19:21,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:19:21,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:19:21,296::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:19:21,296::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:19:21,296::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:19:21,296::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:19:21,296::task::990::TaskManager.Task::(_decref) Task=`27cda6e0-d21e-4143-af3f-9fe0a643dcd1`::ref 0 aborting False >BindingXMLRPC::ERROR::2014-03-30 11:19:22,198::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:22,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:22,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370862 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:24,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:24,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045261 s, 22.6 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:25,209::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:26,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:26,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458162 s, 22.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:19:26,776::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:19:26,798::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00841242 s, 487 kB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-03-30 11:19:27,584::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:19:27,595::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000353979 s, 977 kB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:28,220::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:28,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:28,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426576 s, 24.0 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:30,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:30,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054375 s, 18.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:31,233::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:19:31,323::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-13::DEBUG::2014-03-30 11:19:31,324::task::595::TaskManager.Task::(_updateState) Task=`6c415cf7-2519-4f37-9a3b-86c2357d68c0`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:31,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:19:31,353::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:31,353::task::1185::TaskManager.Task::(prepare) Task=`6c415cf7-2519-4f37-9a3b-86c2357d68c0`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:31,354::task::595::TaskManager.Task::(_updateState) Task=`6c415cf7-2519-4f37-9a3b-86c2357d68c0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:31,354::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:31,354::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:31,354::task::990::TaskManager.Task::(_decref) Task=`6c415cf7-2519-4f37-9a3b-86c2357d68c0`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:19:31,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] >Thread-236::DEBUG::2014-03-30 11:19:31,361::task::595::TaskManager.Task::(_updateState) Task=`ebcba7f1-5ea3-479f-befd-5864b04fef71`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:19:31,362::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:19:31,362::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bea1c792-13de-4637-a56a-d8ecb438d3cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:19:31,363::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:19:31,363::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:19:31,364::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`bea1c792-13de-4637-a56a-d8ecb438d3cd`::Granted request >Thread-236::DEBUG::2014-03-30 11:19:31,365::task::827::TaskManager.Task::(resourceAcquired) Task=`ebcba7f1-5ea3-479f-befd-5864b04fef71`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:19:31,365::task::990::TaskManager.Task::(_decref) Task=`ebcba7f1-5ea3-479f-befd-5864b04fef71`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:19:31,366::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615751168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:31,366::task::1185::TaskManager.Task::(prepare) Task=`ebcba7f1-5ea3-479f-befd-5864b04fef71`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615751168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:31,366::task::595::TaskManager.Task::(_updateState) Task=`ebcba7f1-5ea3-479f-befd-5864b04fef71`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:19:31,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:19:31,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:19:31,367::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:19:31,367::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:19:31,368::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:19:31,368::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:19:31,368::task::990::TaskManager.Task::(_decref) Task=`ebcba7f1-5ea3-479f-befd-5864b04fef71`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:19:32,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:33,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449904 s, 22.8 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:34,246::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-13::DEBUG::2014-03-30 11:19:34,268::task::595::TaskManager.Task::(_updateState) Task=`4dc85ecf-a319-4e7f-8e41-cbd2b02b3e76`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:34,268::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-03-30 11:19:34,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00841242', 'lastCheck': '7.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000353979', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:19:34,268::task::1185::TaskManager.Task::(prepare) Task=`4dc85ecf-a319-4e7f-8e41-cbd2b02b3e76`::finished: {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00841242', 'lastCheck': '7.5', 'valid': True}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'code': 0, 'version': 0, 'acquired': True, 'delay': '0.000353979', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-03-30 11:19:34,269::task::595::TaskManager.Task::(_updateState) Task=`4dc85ecf-a319-4e7f-8e41-cbd2b02b3e76`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:34,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:34,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:34,269::task::990::TaskManager.Task::(_decref) Task=`4dc85ecf-a319-4e7f-8e41-cbd2b02b3e76`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:19:35,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:35,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373068 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-03-30 11:19:36,806::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/dcfe3432-59a5-4a2f-b358-6d91f31b3e62/metadata bs=4096 count=1' (cwd None) >Thread-14::DEBUG::2014-03-30 11:19:36,825::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00614378 s, 667 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:37,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:37,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450568 s, 22.7 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:37,258::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Thread-15::DEBUG::2014-03-30 11:19:37,606::fileSD::225::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/rhev/data-center/mnt/10.35.160.108:_RHEV_kuk/3ffbee88-0d84-4a95-bba0-e8c2b2cfc114/dom_md/metadata bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-03-30 11:19:37,618::fileSD::225::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n346 bytes (346 B) copied, 0.000441658 s, 783 kB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:39,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:39,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052967 s, 19.3 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:40,271::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:41,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-03-30 11:19:41,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [38527186] >Thread-13::DEBUG::2014-03-30 11:19:41,402::task::595::TaskManager.Task::(_updateState) Task=`4fc054b4-b7aa-4f84-82a6-88e62588ad46`::moving from state init -> state preparing >Thread-13::INFO::2014-03-30 11:19:41,403::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-13::INFO::2014-03-30 11:19:41,444::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:41,448::task::1185::TaskManager.Task::(prepare) Task=`4fc054b4-b7aa-4f84-82a6-88e62588ad46`::finished: {'spm_st': {'spmId': 2, 'spmStatus': 'SPM', 'spmLver': 17L}} >Thread-13::DEBUG::2014-03-30 11:19:41,452::task::595::TaskManager.Task::(_updateState) Task=`4fc054b4-b7aa-4f84-82a6-88e62588ad46`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-03-30 11:19:41,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-03-30 11:19:41,460::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-03-30 11:19:41,465::task::990::TaskManager.Task::(_decref) Task=`4fc054b4-b7aa-4f84-82a6-88e62588ad46`::ref 0 aborting False >Thread-236::DEBUG::2014-03-30 11:19:41,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.162.28] flowID [38527186] >Thread-236::DEBUG::2014-03-30 11:19:41,485::task::595::TaskManager.Task::(_updateState) Task=`72006b83-284f-489a-a056-4ca470de556c`::moving from state init -> state preparing >Thread-236::INFO::2014-03-30 11:19:41,486::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', options=None) >Thread-236::DEBUG::2014-03-30 11:19:41,489::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`31b11dd7-3711-48a8-9efe-cf329da1b0ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-236::DEBUG::2014-03-30 11:19:41,490::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' for lock type 'shared' >Thread-236::DEBUG::2014-03-30 11:19:41,492::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free. Now locking as 'shared' (1 active user) >Thread-236::DEBUG::2014-03-30 11:19:41,493::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb`ReqID=`31b11dd7-3711-48a8-9efe-cf329da1b0ab`::Granted request >Thread-236::DEBUG::2014-03-30 11:19:41,496::task::827::TaskManager.Task::(resourceAcquired) Task=`72006b83-284f-489a-a056-4ca470de556c`::_resourcesAcquired: Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb (shared) >Thread-236::DEBUG::2014-03-30 11:19:41,497::task::990::TaskManager.Task::(_decref) Task=`72006b83-284f-489a-a056-4ca470de556c`::ref 1 aborting False >Thread-236::INFO::2014-03-30 11:19:41,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615751168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:41,504::task::1185::TaskManager.Task::(prepare) Task=`72006b83-284f-489a-a056-4ca470de556c`::finished: {'info': {'name': 'Imp_Exp_DC0', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62:Active,3ffbee88-0d84-4a95-bba0-e8c2b2cfc114:Active', 'master_uuid': 'dcfe3432-59a5-4a2f-b358-6d91f31b3e62', 'version': '3', 'spm_id': 2, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'dcfe3432-59a5-4a2f-b358-6d91f31b3e62': {'status': u'Active', 'diskfree': '65229815808', 'isoprefix': '', 'alerts': [], 'disktotal': '74759274496', 'version': 3}, u'3ffbee88-0d84-4a95-bba0-e8c2b2cfc114': {'status': u'Active', 'diskfree': '2013615751168', 'isoprefix': '', 'alerts': [], 'disktotal': '2163246071808', 'version': 0}}} >Thread-236::DEBUG::2014-03-30 11:19:41,506::task::595::TaskManager.Task::(_updateState) Task=`72006b83-284f-489a-a056-4ca470de556c`::moving from state preparing -> state finished >Thread-236::DEBUG::2014-03-30 11:19:41,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb': < ResourceRef 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', isValid: 'True' obj: 'None'>} >Thread-236::DEBUG::2014-03-30 11:19:41,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-236::DEBUG::2014-03-30 11:19:41,510::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' >Thread-236::DEBUG::2014-03-30 11:19:41,511::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' (0 active users) >Thread-236::DEBUG::2014-03-30 11:19:41,512::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb' is free, finding out if anyone is waiting for it. >Thread-236::DEBUG::2014-03-30 11:19:41,513::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb', Clearing records. >Thread-236::DEBUG::2014-03-30 11:19:41,515::task::990::TaskManager.Task::(_decref) Task=`72006b83-284f-489a-a056-4ca470de556c`::ref 0 aborting False >Dummy-36::DEBUG::2014-03-30 11:19:41,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.122336 s, 8.4 MB/s\n'; <rc> = 0 >BindingXMLRPC::ERROR::2014-03-30 11:19:43,284::BindingXMLRPC::84::vds::(threaded_start) xml-rpc handler exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 80, in threaded_start > self.server.handle_request() > File "/usr/lib64/python2.6/SocketServer.py", line 278, in handle_request > self._handle_request_noblock() > File "/usr/lib64/python2.6/SocketServer.py", line 288, in _handle_request_noblock > request, client_address = self.get_request() > File "/usr/lib64/python2.6/SocketServer.py", line 456, in get_request > return self.socket.accept() > File "/usr/lib64/python2.6/site-packages/vdsm/SecureXMLRPCServer.py", line 136, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: sslv3 alert certificate unknown, client 10.35.161.40 >Dummy-36::DEBUG::2014-03-30 11:19:43,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:43,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448724 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-36::DEBUG::2014-03-30 11:19:45,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/ab2bb20c-f3ca-468b-b2a9-61b7f88a3ecb/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-36::DEBUG::2014-03-30 11:19:45,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374725 s, 27.3 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1082275
: 880265