Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 902185 Details for
Bug 1104672
prepareVolume fails to activate volume
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log
vdsm.log (text/plain), 1.74 MB, created by
Jiri Moskovcak
on 2014-06-04 13:30:13 UTC
(
hide
)
Description:
vdsm log
Filename:
MIME Type:
Creator:
Jiri Moskovcak
Created:
2014-06-04 13:30:13 UTC
Size:
1.74 MB
patch
obsolete
>MainThread::INFO::2014-06-04 11:02:16,688::vdsm::119::vds::(run) (PID: 33928) I am the actual vdsm 4.14.6-0.el6 localhost.localdomain (2.6.32-431.el6.x86_64) >MainThread::DEBUG::2014-06-04 11:02:16,689::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-06-04 11:02:16,689::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::DEBUG::2014-06-04 11:02:16,991::multipath::151::Storage.Multipath::(isEnabled) multipath Defaulting to False >MainThread::DEBUG::2014-06-04 11:02:16,992::multipath::169::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /bin/cp /tmp/tmpL6EIg3 /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2014-06-04 11:02:17,001::multipath::169::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:02:17,003::multipath::175::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2014-06-04 11:02:17,018::multipath::175::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:02:17,019::multipath::178::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /usr/bin/vdsm-tool service-reload multipathd' (cwd None) >MainThread::DEBUG::2014-06-04 11:02:17,196::multipath::178::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:02:17,197::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-06-04 11:02:17,309::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:02:17,309::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-06-04 11:02:17,312::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-06-04 11:02:17,312::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-06-04 11:02:17,312::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-06-04 11:02:17,314::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-06-04 11:02:17,314::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-06-04 11:02:17,315::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-06-04 11:02:17,336::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:02:17,336::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-06-04 11:02:17,342::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:02:17,343::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-06-04 11:02:17,343::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >MainThread::DEBUG::2014-06-04 11:02:17,372::task::595::TaskManager.Task::(_updateState) Task=`44983a01-d4a9-4bd0-813f-c877449edcb4`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:02:17,372::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0xec5098>>) >MainThread::INFO::2014-06-04 11:02:17,373::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-06-04 11:02:17,373::task::1185::TaskManager.Task::(prepare) Task=`44983a01-d4a9-4bd0-813f-c877449edcb4`::finished: None >MainThread::DEBUG::2014-06-04 11:02:17,373::task::595::TaskManager.Task::(_updateState) Task=`44983a01-d4a9-4bd0-813f-c877449edcb4`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:02:17,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:02:17,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:02:17,373::task::990::TaskManager.Task::(_decref) Task=`44983a01-d4a9-4bd0-813f-c877449edcb4`::ref 0 aborting False >storageRefresh::DEBUG::2014-06-04 11:02:17,374::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:02:17,374::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >MainThread::INFO::2014-06-04 11:02:17,380::momIF::47::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-06-04 11:02:17,384::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2014-06-04 11:02:17,395::libvirtconnection::145::root::(get) trying to connect libvirt >VM Channels Listener::INFO::2014-06-04 11:02:17,402::vmChannels::170::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2014-06-04 11:02:17,417::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >storageRefresh::DEBUG::2014-06-04 11:02:17,417::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:02:17,419::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,419::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,419::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,420::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,420::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,420::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,420::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:02:17,420::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,422::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:02:17,521::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:02:17,522::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,523::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,525::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-06-04 11:02:17,545::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-06-04 11:02:17,545::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-06-04 11:02:17,620::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:02:17,620::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,620::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:02:17,716::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:02:17,717::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,718::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:02:17,806::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:02:17,806::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:02:17,807::hsm::391::Storage.HSM::(storageRefresh) HSM is ready >Thread-14::DEBUG::2014-06-04 11:02:18,614::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-14::DEBUG::2014-06-04 11:02:18,615::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >Thread-14::DEBUG::2014-06-04 11:02:18,659::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL320e Gen8', 'systemSerialNumber': 'CZ134300VX', 'systemFamily': 'ProLiant', 'systemVersion': 'Not Specified', 'systemUUID': '30303734-3536-5A43-3133-343330305658', 'systemManufacturer': 'HP'}} >Thread-16::DEBUG::2014-06-04 11:02:18,784::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-16::DEBUG::2014-06-04 11:02:18,785::task::595::TaskManager.Task::(_updateState) Task=`18bcae5a-fda1-4c78-908c-35e7e4ac12a2`::moving from state init -> state preparing >Thread-16::INFO::2014-06-04 11:02:18,785::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >Thread-16::INFO::2014-06-04 11:02:18,785::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >Thread-16::DEBUG::2014-06-04 11:02:18,785::task::1185::TaskManager.Task::(prepare) Task=`18bcae5a-fda1-4c78-908c-35e7e4ac12a2`::finished: {'poollist': []} >Thread-16::DEBUG::2014-06-04 11:02:18,785::task::595::TaskManager.Task::(_updateState) Task=`18bcae5a-fda1-4c78-908c-35e7e4ac12a2`::moving from state preparing -> state finished >Thread-16::DEBUG::2014-06-04 11:02:18,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16::DEBUG::2014-06-04 11:02:18,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16::DEBUG::2014-06-04 11:02:18,786::task::990::TaskManager.Task::(_decref) Task=`18bcae5a-fda1-4c78-908c-35e7e4ac12a2`::ref 0 aborting False >Thread-17::DEBUG::2014-06-04 11:02:34,672::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-17::ERROR::2014-06-04 11:02:34,677::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-17::DEBUG::2014-06-04 11:02:34,681::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-18::DEBUG::2014-06-04 11:02:35,734::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-18::ERROR::2014-06-04 11:02:35,734::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-18::DEBUG::2014-06-04 11:02:35,735::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-19::DEBUG::2014-06-04 11:02:36,784::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-19::ERROR::2014-06-04 11:02:36,784::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-19::DEBUG::2014-06-04 11:02:36,785::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-20::DEBUG::2014-06-04 11:02:37,834::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-20::ERROR::2014-06-04 11:02:37,834::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-20::DEBUG::2014-06-04 11:02:37,835::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-21::DEBUG::2014-06-04 11:02:38,884::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-21::ERROR::2014-06-04 11:02:38,884::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-21::DEBUG::2014-06-04 11:02:38,885::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-22::DEBUG::2014-06-04 11:02:39,934::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-22::ERROR::2014-06-04 11:02:39,934::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-22::DEBUG::2014-06-04 11:02:39,935::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-23::DEBUG::2014-06-04 11:02:40,984::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-23::ERROR::2014-06-04 11:02:40,984::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-23::DEBUG::2014-06-04 11:02:40,985::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-24::DEBUG::2014-06-04 11:02:42,034::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-24::ERROR::2014-06-04 11:02:42,034::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-24::DEBUG::2014-06-04 11:02:42,035::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-25::DEBUG::2014-06-04 11:02:43,084::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-25::ERROR::2014-06-04 11:02:43,127::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-25::DEBUG::2014-06-04 11:02:43,128::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-26::DEBUG::2014-06-04 11:02:44,177::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-26::ERROR::2014-06-04 11:02:44,177::API::1198::vds::(getHardwareInfo) failed to retrieve hardware info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1195, in getHardwareInfo > hw = supervdsm.getProxy().getHardwareInfo() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getHardwareInfo > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-26::DEBUG::2014-06-04 11:02:44,178::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Failed to read hardware information', 'code': 57}} >Thread-28::DEBUG::2014-06-04 11:02:45,287::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-28::DEBUG::2014-06-04 11:02:45,288::task::595::TaskManager.Task::(_updateState) Task=`e413891d-f958-4a1b-a6ac-d030d2668caf`::moving from state init -> state preparing >Thread-28::INFO::2014-06-04 11:02:45,288::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >Thread-28::INFO::2014-06-04 11:02:45,288::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >Thread-28::DEBUG::2014-06-04 11:02:45,288::task::1185::TaskManager.Task::(prepare) Task=`e413891d-f958-4a1b-a6ac-d030d2668caf`::finished: {'poollist': []} >Thread-28::DEBUG::2014-06-04 11:02:45,288::task::595::TaskManager.Task::(_updateState) Task=`e413891d-f958-4a1b-a6ac-d030d2668caf`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-06-04 11:02:45,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-06-04 11:02:45,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-06-04 11:02:45,289::task::990::TaskManager.Task::(_decref) Task=`e413891d-f958-4a1b-a6ac-d030d2668caf`::ref 0 aborting False >Thread-29::DEBUG::2014-06-04 11:02:51,110::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-29::DEBUG::2014-06-04 11:02:51,111::task::595::TaskManager.Task::(_updateState) Task=`677d5ddc-d9fe-49c9-8cce-f40faac4dcf0`::moving from state init -> state preparing >Thread-29::INFO::2014-06-04 11:02:51,111::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.34.131.193', 'password': '******', 'port': '3260', 'user': 'engine'}, options=None) >Thread-29::DEBUG::2014-06-04 11:02:51,111::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --op=new' (cwd None) >Thread-29::DEBUG::2014-06-04 11:02:51,146::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:02:51,147::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.authmethod -v **** --op=update' (cwd None) >Thread-29::DEBUG::2014-06-04 11:02:51,157::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:02:51,158::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.username -v **** --op=update' (cwd None) >Thread-29::DEBUG::2014-06-04 11:02:51,196::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:02:51,197::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.password -v **** --op=update' (cwd None) >Thread-29::DEBUG::2014-06-04 11:02:51,224::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:02:51,225::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --discover' (cwd None) >Thread-29::DEBUG::2014-06-04 11:02:51,239::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:02:51,240::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --op=delete' (cwd None) >Thread-29::DEBUG::2014-06-04 11:02:51,250::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::INFO::2014-06-04 11:02:51,251::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.34.131.193:3260,1 iqn.2009-02.com.example:for.all'], 'targets': ['iqn.2009-02.com.example:for.all']} >Thread-29::DEBUG::2014-06-04 11:02:51,251::task::1185::TaskManager.Task::(prepare) Task=`677d5ddc-d9fe-49c9-8cce-f40faac4dcf0`::finished: {'fullTargets': ['10.34.131.193:3260,1 iqn.2009-02.com.example:for.all'], 'targets': ['iqn.2009-02.com.example:for.all']} >Thread-29::DEBUG::2014-06-04 11:02:51,251::task::595::TaskManager.Task::(_updateState) Task=`677d5ddc-d9fe-49c9-8cce-f40faac4dcf0`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-06-04 11:02:51,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2014-06-04 11:02:51,252::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-06-04 11:02:51,252::task::990::TaskManager.Task::(_decref) Task=`677d5ddc-d9fe-49c9-8cce-f40faac4dcf0`::ref 0 aborting False >Thread-30::DEBUG::2014-06-04 11:02:51,300::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-30::DEBUG::2014-06-04 11:02:51,301::task::595::TaskManager.Task::(_updateState) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::moving from state init -> state preparing >Thread-30::INFO::2014-06-04 11:02:51,301::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-30::DEBUG::2014-06-04 11:02:51,301::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-30::DEBUG::2014-06-04 11:02:51,301::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-30::DEBUG::2014-06-04 11:02:51,301::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-30::DEBUG::2014-06-04 11:02:51,302::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-30::DEBUG::2014-06-04 11:02:51,302::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-30::DEBUG::2014-06-04 11:02:51,302::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-30::DEBUG::2014-06-04 11:02:51,312::misc::772::SamplingMethod::(__call__) Returning last result >Thread-30::DEBUG::2014-06-04 11:02:51,312::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-30::DEBUG::2014-06-04 11:02:51,400::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-06-04 11:02:51,400::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,401::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,401::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,401::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,401::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,402::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,402::misc::772::SamplingMethod::(__call__) Returning last result >Thread-30::DEBUG::2014-06-04 11:02:51,402::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-30::DEBUG::2014-06-04 11:02:51,404::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-30::DEBUG::2014-06-04 11:02:51,523::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-30::DEBUG::2014-06-04 11:02:51,523::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-30::ERROR::2014-06-04 11:02:51,527::task::866::TaskManager.Task::(_setError) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 1899, in getDeviceList > devices = self._getDeviceList(storageType) > File "/usr/share/vdsm/storage/hsm.py", line 1931, in _getDeviceList > for dev in multipath.pathListIter(guids): > File "/usr/share/vdsm/storage/multipath.py", line 255, in pathListIter > pathStatuses = devicemapper.getPathsStatus() > File "/usr/share/vdsm/storage/devicemapper.py", line 177, in getPathsStatus > return getProxy().getPathsStatus() > File "/usr/share/vdsm/supervdsm.py", line 50, in __call__ > return callMethod() > File "/usr/share/vdsm/supervdsm.py", line 48, in <lambda> > **kwargs) > File "<string>", line 2, in getPathsStatus > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 722, in _callmethod > self._connect() > File "/usr/lib64/python2.6/multiprocessing/managers.py", line 709, in _connect > conn = self._Client(self._token.address, authkey=self._authkey) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 143, in Client > c = SocketClient(address) > File "/usr/lib64/python2.6/multiprocessing/connection.py", line 263, in SocketClient > s.connect(address) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-30::DEBUG::2014-06-04 11:02:51,528::task::885::TaskManager.Task::(_run) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::Task._run: fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe (3,) {} failed - stopping task >Thread-30::DEBUG::2014-06-04 11:02:51,528::task::1211::TaskManager.Task::(stop) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::stopping in state preparing (force False) >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::990::TaskManager.Task::(_decref) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::ref 1 aborting True >Thread-30::INFO::2014-06-04 11:02:51,529::task::1168::TaskManager.Task::(prepare) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::aborting: Task is aborted: u'[Errno 2] No such file or directory' - code 100 >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::1173::TaskManager.Task::(prepare) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::Prepare: aborted: [Errno 2] No such file or directory >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::990::TaskManager.Task::(_decref) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::ref 0 aborting True >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::925::TaskManager.Task::(_doAbort) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::Task._doAbort: force False >Thread-30::DEBUG::2014-06-04 11:02:51,529::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::595::TaskManager.Task::(_updateState) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::moving from state preparing -> state aborting >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::550::TaskManager.Task::(__state_aborting) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::_aborting: recover policy none >Thread-30::DEBUG::2014-06-04 11:02:51,529::task::595::TaskManager.Task::(_updateState) Task=`fb9f3ed2-b5e5-4b40-94e9-c7b861ec9bfe`::moving from state aborting -> state failed >Thread-30::DEBUG::2014-06-04 11:02:51,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2014-06-04 11:02:51,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::ERROR::2014-06-04 11:02:51,530::dispatcher::68::Storage.Dispatcher.Protect::(run) [Errno 2] No such file or directory >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 60, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1176, in prepare > raise self.error >error: [Errno 2] No such file or directory >MainThread::DEBUG::2014-06-04 11:03:52,027::vdsm::55::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-06-04 11:03:52,326::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-06-04 11:03:52,326::momIF::84::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-06-04 11:03:52,326::task::595::TaskManager.Task::(_updateState) Task=`6692437f-bfb9-4cf7-ba35-4542eeff1f0b`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:03:52,327::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-06-04 11:03:52,327::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >VM Channels Listener::INFO::2014-06-04 11:03:52,516::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-06-04 11:03:52,611::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2014-06-04 11:03:52,611::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-06-04 11:03:52,611::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-06-04 11:03:52,611::task::1185::TaskManager.Task::(prepare) Task=`6692437f-bfb9-4cf7-ba35-4542eeff1f0b`::finished: None >MainThread::DEBUG::2014-06-04 11:03:52,612::task::595::TaskManager.Task::(_updateState) Task=`6692437f-bfb9-4cf7-ba35-4542eeff1f0b`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:03:52,612::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:03:52,612::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:03:52,612::task::990::TaskManager.Task::(_decref) Task=`6692437f-bfb9-4cf7-ba35-4542eeff1f0b`::ref 0 aborting False >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 11 other threads... >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <_MainThread(MainThread, started 140382577800960)> >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 140382309865216)> >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <WorkerThread(Thread-2, started daemon 140382214027008)> >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 140382161577728)> >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 140381733775104)> >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <WorkerThread(Thread-5, started daemon 140382182557440)> >MainThread::INFO::2014-06-04 11:03:52,612::vdsm::129::vds::(run) <WorkerThread(Thread-4, started daemon 140382193047296)> >MainThread::INFO::2014-06-04 11:03:52,613::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 140382172067584)> >MainThread::INFO::2014-06-04 11:03:52,613::vdsm::129::vds::(run) <WorkerThread(Thread-1, started daemon 140382299375360)> >MainThread::INFO::2014-06-04 11:03:52,613::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 140381744264960)> >MainThread::INFO::2014-06-04 11:03:52,613::vdsm::129::vds::(run) <WorkerThread(Thread-3, started daemon 140382203537152)> >MainThread::INFO::2014-06-04 11:03:52,613::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 140381723285248)> >MainThread::INFO::2014-06-04 11:03:55,089::vdsm::119::vds::(run) (PID: 34359) I am the actual vdsm 4.14.6-0.el6 localhost.localdomain (2.6.32-431.el6.x86_64) >MainThread::DEBUG::2014-06-04 11:03:55,090::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-06-04 11:03:55,090::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2014-06-04 11:03:55,093::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-06-04 11:03:55,336::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-06-04 11:03:55,350::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-06-04 11:03:55,350::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-06-04 11:03:55,454::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:03:55,454::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-06-04 11:03:55,458::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-06-04 11:03:55,458::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-06-04 11:03:55,458::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-06-04 11:03:55,459::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-06-04 11:03:55,460::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-06-04 11:03:55,461::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-06-04 11:03:55,470::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:03:55,481::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-06-04 11:03:55,481::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:03:55,481::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-06-04 11:03:55,481::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:03:55,492::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:03:55,492::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >MainThread::DEBUG::2014-06-04 11:03:55,508::task::595::TaskManager.Task::(_updateState) Task=`9e0ff196-6b16-44a7-8751-933cb91c838e`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:03:55,508::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x1c5ba70>>) >MainThread::INFO::2014-06-04 11:03:55,508::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-06-04 11:03:55,508::task::1185::TaskManager.Task::(prepare) Task=`9e0ff196-6b16-44a7-8751-933cb91c838e`::finished: None >MainThread::DEBUG::2014-06-04 11:03:55,508::task::595::TaskManager.Task::(_updateState) Task=`9e0ff196-6b16-44a7-8751-933cb91c838e`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:03:55,509::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:03:55,509::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:03:55,509::task::990::TaskManager.Task::(_decref) Task=`9e0ff196-6b16-44a7-8751-933cb91c838e`::ref 0 aborting False >MainThread::INFO::2014-06-04 11:03:55,516::momIF::47::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-06-04 11:03:55,521::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-06-04 11:03:55,522::vmChannels::170::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-06-04 11:03:55,536::libvirtconnection::145::root::(get) trying to connect libvirt >MainThread::WARNING::2014-06-04 11:03:55,542::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >storageRefresh::DEBUG::2014-06-04 11:03:55,576::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:03:55,578::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,580::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,582::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,606::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,607::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,608::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,609::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:03:55,610::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,615::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:03:55,719::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:03:55,719::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,720::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,720::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:03:55,809::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:03:55,810::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,810::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:03:55,901::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:03:55,902::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:03:55,902::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:03:55,991::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:03:55,991::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::WARNING::2014-06-04 11:03:55,992::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >storageRefresh::DEBUG::2014-06-04 11:03:55,992::hsm::391::Storage.HSM::(storageRefresh) HSM is ready >Thread-13::DEBUG::2014-06-04 11:04:02,857::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-06-04 11:04:02,893::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL320e Gen8', 'systemSerialNumber': 'CZ134300VX', 'systemFamily': 'ProLiant', 'systemVersion': 'Not Specified', 'systemUUID': '30303734-3536-5A43-3133-343330305658', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2014-06-04 11:04:03,001::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-15::DEBUG::2014-06-04 11:04:03,002::task::595::TaskManager.Task::(_updateState) Task=`1eba3ebb-38a7-40b4-888c-42c24b5999ec`::moving from state init -> state preparing >Thread-15::INFO::2014-06-04 11:04:03,002::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >Thread-15::INFO::2014-06-04 11:04:03,002::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >Thread-15::DEBUG::2014-06-04 11:04:03,002::task::1185::TaskManager.Task::(prepare) Task=`1eba3ebb-38a7-40b4-888c-42c24b5999ec`::finished: {'poollist': []} >Thread-15::DEBUG::2014-06-04 11:04:03,002::task::595::TaskManager.Task::(_updateState) Task=`1eba3ebb-38a7-40b4-888c-42c24b5999ec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-06-04 11:04:03,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-06-04 11:04:03,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-06-04 11:04:03,003::task::990::TaskManager.Task::(_decref) Task=`1eba3ebb-38a7-40b4-888c-42c24b5999ec`::ref 0 aborting False >Thread-16::DEBUG::2014-06-04 11:04:05,388::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-16::DEBUG::2014-06-04 11:04:05,389::task::595::TaskManager.Task::(_updateState) Task=`5f89068b-4575-4d26-9d00-1b404661b069`::moving from state init -> state preparing >Thread-16::INFO::2014-06-04 11:04:05,389::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.34.131.193', 'password': '******', 'port': '3260', 'user': 'engine'}, options=None) >Thread-16::DEBUG::2014-06-04 11:04:05,389::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --op=new' (cwd None) >Thread-16::DEBUG::2014-06-04 11:04:05,409::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-06-04 11:04:05,410::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.authmethod -v **** --op=update' (cwd None) >Thread-16::DEBUG::2014-06-04 11:04:05,420::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-06-04 11:04:05,421::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.username -v **** --op=update' (cwd None) >Thread-16::DEBUG::2014-06-04 11:04:05,440::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-06-04 11:04:05,440::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.password -v **** --op=update' (cwd None) >Thread-16::DEBUG::2014-06-04 11:04:05,450::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-06-04 11:04:05,451::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --discover' (cwd None) >Thread-16::DEBUG::2014-06-04 11:04:05,465::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::DEBUG::2014-06-04 11:04:05,465::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --op=delete' (cwd None) >Thread-16::DEBUG::2014-06-04 11:04:05,499::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-16::INFO::2014-06-04 11:04:05,499::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.34.131.193:3260,1 iqn.2009-02.com.example:for.all'], 'targets': ['iqn.2009-02.com.example:for.all']} >Thread-16::DEBUG::2014-06-04 11:04:05,499::task::1185::TaskManager.Task::(prepare) Task=`5f89068b-4575-4d26-9d00-1b404661b069`::finished: {'fullTargets': ['10.34.131.193:3260,1 iqn.2009-02.com.example:for.all'], 'targets': ['iqn.2009-02.com.example:for.all']} >Thread-16::DEBUG::2014-06-04 11:04:05,500::task::595::TaskManager.Task::(_updateState) Task=`5f89068b-4575-4d26-9d00-1b404661b069`::moving from state preparing -> state finished >Thread-16::DEBUG::2014-06-04 11:04:05,500::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-16::DEBUG::2014-06-04 11:04:05,500::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-16::DEBUG::2014-06-04 11:04:05,500::task::990::TaskManager.Task::(_decref) Task=`5f89068b-4575-4d26-9d00-1b404661b069`::ref 0 aborting False >Thread-17::DEBUG::2014-06-04 11:04:05,550::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-17::DEBUG::2014-06-04 11:04:05,551::task::595::TaskManager.Task::(_updateState) Task=`bc1c0027-a3b5-4d9c-8491-0ea319b9deb7`::moving from state init -> state preparing >Thread-17::INFO::2014-06-04 11:04:05,551::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-17::DEBUG::2014-06-04 11:04:05,552::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-17::DEBUG::2014-06-04 11:04:05,552::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-17::DEBUG::2014-06-04 11:04:05,552::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-17::DEBUG::2014-06-04 11:04:05,552::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-17::DEBUG::2014-06-04 11:04:05,552::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-17::DEBUG::2014-06-04 11:04:05,553::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-17::DEBUG::2014-06-04 11:04:05,562::misc::772::SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-06-04 11:04:05,563::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-17::DEBUG::2014-06-04 11:04:05,641::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-06-04 11:04:05,641::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,642::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,642::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,645::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,646::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,646::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,646::misc::772::SamplingMethod::(__call__) Returning last result >Thread-17::DEBUG::2014-06-04 11:04:05,647::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,649::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-17::DEBUG::2014-06-04 11:04:05,784::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-06-04 11:04:05,784::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-06-04 11:04:05,808::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-17::DEBUG::2014-06-04 11:04:05,894::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-17::DEBUG::2014-06-04 11:04:05,895::lvm::859::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-17::INFO::2014-06-04 11:04:05,895::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-17::DEBUG::2014-06-04 11:04:05,895::task::1185::TaskManager.Task::(prepare) Task=`bc1c0027-a3b5-4d9c-8491-0ea319b9deb7`::finished: {'devList': []} >Thread-17::DEBUG::2014-06-04 11:04:05,895::task::595::TaskManager.Task::(_updateState) Task=`bc1c0027-a3b5-4d9c-8491-0ea319b9deb7`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-06-04 11:04:05,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-06-04 11:04:05,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-06-04 11:04:05,896::task::990::TaskManager.Task::(_decref) Task=`bc1c0027-a3b5-4d9c-8491-0ea319b9deb7`::ref 0 aborting False >Thread-18::DEBUG::2014-06-04 11:04:05,955::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-18::DEBUG::2014-06-04 11:04:05,956::task::595::TaskManager.Task::(_updateState) Task=`a3c180c5-d1dc-43e1-8777-50e029bf2df3`::moving from state init -> state preparing >Thread-18::INFO::2014-06-04 11:04:05,956::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.34.131.193', 'password': '******', 'port': '3260', 'user': 'engine'}, options=None) >Thread-18::DEBUG::2014-06-04 11:04:05,957::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --op=new' (cwd None) >Thread-18::DEBUG::2014-06-04 11:04:05,970::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:04:05,970::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.authmethod -v **** --op=update' (cwd None) >Thread-18::DEBUG::2014-06-04 11:04:05,981::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:04:05,981::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.username -v **** --op=update' (cwd None) >Thread-18::DEBUG::2014-06-04 11:04:05,992::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:04:05,992::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 -n discovery.sendtargets.auth.password -v **** --op=update' (cwd None) >Thread-18::DEBUG::2014-06-04 11:04:06,031::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:04:06,032::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --discover' (cwd None) >Thread-18::DEBUG::2014-06-04 11:04:06,044::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:04:06,045::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.34.131.193:3260 --op=delete' (cwd None) >Thread-18::DEBUG::2014-06-04 11:04:06,057::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::INFO::2014-06-04 11:04:06,057::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.34.131.193:3260,1 iqn.2009-02.com.example:for.all'], 'targets': ['iqn.2009-02.com.example:for.all']} >Thread-18::DEBUG::2014-06-04 11:04:06,057::task::1185::TaskManager.Task::(prepare) Task=`a3c180c5-d1dc-43e1-8777-50e029bf2df3`::finished: {'fullTargets': ['10.34.131.193:3260,1 iqn.2009-02.com.example:for.all'], 'targets': ['iqn.2009-02.com.example:for.all']} >Thread-18::DEBUG::2014-06-04 11:04:06,057::task::595::TaskManager.Task::(_updateState) Task=`a3c180c5-d1dc-43e1-8777-50e029bf2df3`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-06-04 11:04:06,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-06-04 11:04:06,058::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-06-04 11:04:06,058::task::990::TaskManager.Task::(_decref) Task=`a3c180c5-d1dc-43e1-8777-50e029bf2df3`::ref 0 aborting False >Thread-19::DEBUG::2014-06-04 11:04:06,108::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-19::DEBUG::2014-06-04 11:04:06,108::task::595::TaskManager.Task::(_updateState) Task=`fdebec06-066d-42bb-96f1-e6e020682ff5`::moving from state init -> state preparing >Thread-19::INFO::2014-06-04 11:04:06,108::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '0', 'user': 'engine', 'password': '******', 'port': '3260', 'id': '00000000-0000-0000-0000-000000000000'}], options=None) >Thread-19::DEBUG::2014-06-04 11:04:06,109::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 --op=new' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:06,120::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:06,121::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.session.auth.authmethod -v **** --op=update' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:06,131::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:06,131::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.session.auth.username -v **** --op=update' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:06,141::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:06,142::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.session.auth.password -v **** --op=update' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:06,152::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:06,153::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -l' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:07,442::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:07,442::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:07,460::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:07,461::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-19::DEBUG::2014-06-04 11:04:07,461::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-19::DEBUG::2014-06-04 11:04:07,556::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:04:07,558::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-06-04 11:04:07,558::hsm::2341::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-19::DEBUG::2014-06-04 11:04:07,559::hsm::2397::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-19::INFO::2014-06-04 11:04:07,559::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-19::DEBUG::2014-06-04 11:04:07,559::task::1185::TaskManager.Task::(prepare) Task=`fdebec06-066d-42bb-96f1-e6e020682ff5`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-19::DEBUG::2014-06-04 11:04:07,559::task::595::TaskManager.Task::(_updateState) Task=`fdebec06-066d-42bb-96f1-e6e020682ff5`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-06-04 11:04:07,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-06-04 11:04:07,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-06-04 11:04:07,560::task::990::TaskManager.Task::(_decref) Task=`fdebec06-066d-42bb-96f1-e6e020682ff5`::ref 0 aborting False >Thread-20::DEBUG::2014-06-04 11:04:08,614::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-20::DEBUG::2014-06-04 11:04:08,615::task::595::TaskManager.Task::(_updateState) Task=`d5a35068-17f3-44fe-a962-43428d227cb1`::moving from state init -> state preparing >Thread-20::INFO::2014-06-04 11:04:08,615::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-20::DEBUG::2014-06-04 11:04:08,615::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-20::DEBUG::2014-06-04 11:04:08,615::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-20::DEBUG::2014-06-04 11:04:08,615::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-20::DEBUG::2014-06-04 11:04:08,616::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-20::DEBUG::2014-06-04 11:04:08,616::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-20::DEBUG::2014-06-04 11:04:08,616::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-20::DEBUG::2014-06-04 11:04:08,637::misc::772::SamplingMethod::(__call__) Returning last result >Thread-20::DEBUG::2014-06-04 11:04:08,638::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-20::DEBUG::2014-06-04 11:04:08,939::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-06-04 11:04:08,940::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,940::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,940::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,940::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,940::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,940::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,941::misc::772::SamplingMethod::(__call__) Returning last result >Thread-20::DEBUG::2014-06-04 11:04:08,941::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:08,942::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-20::DEBUG::2014-06-04 11:04:09,049::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-06-04 11:04:09,050::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-20::DEBUG::2014-06-04 11:04:09,073::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/33000000100000001' (cwd None) >Thread-20::DEBUG::2014-06-04 11:04:09,189::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n'; <rc> = 0 >Thread-20::INFO::2014-06-04 11:04:09,190::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'IET', 'capacity': '52428800000', 'fwrev': '0001', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'productID': 'VIRTUAL-DISK'}]} >Thread-20::DEBUG::2014-06-04 11:04:09,190::task::1185::TaskManager.Task::(prepare) Task=`d5a35068-17f3-44fe-a962-43428d227cb1`::finished: {'devList': [{'status': 'free', 'fwrev': '0001', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': 'kokotice', 'port': '3260'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'productID': 'VIRTUAL-DISK', 'vendorID': 'IET', 'capacity': '52428800000', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'pvUUID': ''}]} >Thread-20::DEBUG::2014-06-04 11:04:09,190::task::595::TaskManager.Task::(_updateState) Task=`d5a35068-17f3-44fe-a962-43428d227cb1`::moving from state preparing -> state finished >Thread-20::DEBUG::2014-06-04 11:04:09,191::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2014-06-04 11:04:09,191::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2014-06-04 11:04:09,191::task::990::TaskManager.Task::(_decref) Task=`d5a35068-17f3-44fe-a962-43428d227cb1`::ref 0 aborting False >MainThread::DEBUG::2014-06-04 11:05:15,790::vdsm::55::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-06-04 11:05:16,646::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-06-04 11:05:16,647::momIF::84::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-06-04 11:05:16,648::task::595::TaskManager.Task::(_updateState) Task=`11f91abd-54d9-4bde-ae19-ea17ad8e1855`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:05:16,648::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-06-04 11:05:16,649::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2014-06-04 11:05:16,984::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2014-06-04 11:05:16,984::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-06-04 11:05:16,985::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-06-04 11:05:16,985::task::1185::TaskManager.Task::(prepare) Task=`11f91abd-54d9-4bde-ae19-ea17ad8e1855`::finished: None >MainThread::DEBUG::2014-06-04 11:05:16,985::task::595::TaskManager.Task::(_updateState) Task=`11f91abd-54d9-4bde-ae19-ea17ad8e1855`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:05:16,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:05:16,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:05:16,985::task::990::TaskManager.Task::(_decref) Task=`11f91abd-54d9-4bde-ae19-ea17ad8e1855`::ref 0 aborting False >MainThread::INFO::2014-06-04 11:05:16,985::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 16 other threads... >MainThread::INFO::2014-06-04 11:05:16,985::vdsm::129::vds::(run) <_MainThread(MainThread, started 140257523894016)> >MainThread::INFO::2014-06-04 11:05:16,985::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 140257258891008)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-2, started daemon 140257123104512)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 140257091634944)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140255891908352)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <GuestManager(GuestManager, started daemon 140255902398208)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 140257206441728)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-4, started daemon 140257227421440)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-3, started daemon 140257237911296)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-1, started daemon 140257248401152)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 140257112614656)> >MainThread::INFO::2014-06-04 11:05:16,986::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <Listener(VM Channels Listener, started daemon 140256342947584)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 140257102124800)> >MainThread::INFO::2014-06-04 11:05:16,986::vdsm::129::vds::(run) <HostMonitor(HostMonitor, started daemon 140256353437440)> >MainThread::INFO::2014-06-04 11:05:16,987::vdsm::129::vds::(run) <WorkerThread(Thread-5, started daemon 140257216931584)> >MainThread::INFO::2014-06-04 11:05:16,987::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 140257081145088)> >MainThread::INFO::2014-06-04 11:05:16,987::momIF::84::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-06-04 11:05:16,987::vdsm::129::vds::(run) <MomThread(MOM, started 140256363927296)> >VM Channels Listener::INFO::2014-06-04 11:05:17,625::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-06-04 11:05:19,992::vdsm::119::vds::(run) (PID: 35219) I am the actual vdsm 4.14.6-0.el6 localhost.localdomain (2.6.32-431.el6.x86_64) >MainThread::DEBUG::2014-06-04 11:05:19,993::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-06-04 11:05:19,993::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2014-06-04 11:05:19,996::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-06-04 11:05:20,260::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-06-04 11:05:20,273::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-06-04 11:05:20,273::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-06-04 11:05:20,380::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:05:20,380::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-06-04 11:05:20,383::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-06-04 11:05:20,383::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-06-04 11:05:20,384::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-06-04 11:05:20,385::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-06-04 11:05:20,385::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-06-04 11:05:20,387::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-06-04 11:05:20,387::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:05:20,407::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-06-04 11:05:20,407::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:05:20,408::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-06-04 11:05:20,410::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:05:20,424::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:05:20,424::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >MainThread::DEBUG::2014-06-04 11:05:20,432::task::595::TaskManager.Task::(_updateState) Task=`04383d64-e268-43e3-90ed-4be6db8cb906`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:05:20,458::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x2402b48>>) >MainThread::INFO::2014-06-04 11:05:20,458::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-06-04 11:05:20,458::task::1185::TaskManager.Task::(prepare) Task=`04383d64-e268-43e3-90ed-4be6db8cb906`::finished: None >MainThread::DEBUG::2014-06-04 11:05:20,458::task::595::TaskManager.Task::(_updateState) Task=`04383d64-e268-43e3-90ed-4be6db8cb906`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:05:20,458::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:05:20,458::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:05:20,458::task::990::TaskManager.Task::(_decref) Task=`04383d64-e268-43e3-90ed-4be6db8cb906`::ref 0 aborting False >MainThread::INFO::2014-06-04 11:05:20,464::momIF::47::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-06-04 11:05:20,471::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-06-04 11:05:20,471::vmChannels::170::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-06-04 11:05:20,488::libvirtconnection::145::root::(get) trying to connect libvirt >MainThread::WARNING::2014-06-04 11:05:20,492::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >storageRefresh::DEBUG::2014-06-04 11:05:20,756::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:05:20,757::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,757::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,757::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,758::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,758::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,758::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,758::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:05:20,758::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,760::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-06-04 11:05:20,868::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-06-04 11:05:20,868::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-06-04 11:05:20,871::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:05:20,871::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,871::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,871::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:05:20,974::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:05:20,975::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:20,975::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:05:21,070::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:05:21,071::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:05:21,071::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:05:21,161::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:05:21,161::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::WARNING::2014-06-04 11:05:21,162::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >storageRefresh::DEBUG::2014-06-04 11:05:21,162::hsm::391::Storage.HSM::(storageRefresh) HSM is ready >Thread-14::DEBUG::2014-06-04 11:05:21,924::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-14::DEBUG::2014-06-04 11:05:21,927::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL320e Gen8', 'systemSerialNumber': 'CZ134300VX', 'systemFamily': 'ProLiant', 'systemVersion': 'Not Specified', 'systemUUID': '30303734-3536-5A43-3133-343330305658', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2014-06-04 11:05:21,977::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-15::DEBUG::2014-06-04 11:05:22,048::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2014-06-04 11:05:22,062::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-06-04 11:05:22,124::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658_a4:5d:36:11:e1:cc', 'lastClientIface': 'lo', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '255.255.252.0', 'addr': '10.34.63.104', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'IPV6INIT': 'no', 'NM_CONTROLLED': 'yes', 'MTU': '1500', 'HWADDR': 'A4:5D:36:11:E1:CC', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'yes', 'UUID': 'd8eb9fdb-ee7c-4c84-a437-d2b0b93fae95'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '2128.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-16::DEBUG::2014-06-04 11:05:22,275::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call addNetwork with ('ovirtmgmt', '', '', ['eth0'], {'blockingdhcp': 'true', 'bootproto': 'dhcp', 'force': 'False', 'ONBOOT': 'yes', 'bridged': 'True'}) {} >Thread-16::DEBUG::2014-06-04 11:05:23,544::BindingXMLRPC::1074::vds::(wrapper) return addNetwork with {'status': {'message': 'Done', 'code': 0}} >Thread-17::DEBUG::2014-06-04 11:05:23,629::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call setSafeNetworkConfig with () {} >Thread-17::DEBUG::2014-06-04 11:05:23,644::BindingXMLRPC::1074::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Thread-18::DEBUG::2014-06-04 11:05:35,129::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-18::DEBUG::2014-06-04 11:05:35,134::task::595::TaskManager.Task::(_updateState) Task=`fb641675-f27b-4380-ada2-498c64a4c3e1`::moving from state init -> state preparing >Thread-18::INFO::2014-06-04 11:05:35,134::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-18::DEBUG::2014-06-04 11:05:35,134::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-18::DEBUG::2014-06-04 11:05:35,135::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2014-06-04 11:05:35,135::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-18::DEBUG::2014-06-04 11:05:35,135::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2014-06-04 11:05:35,135::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-18::DEBUG::2014-06-04 11:05:35,135::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-18::DEBUG::2014-06-04 11:05:38,172::misc::772::SamplingMethod::(__call__) Returning last result >Thread-18::DEBUG::2014-06-04 11:05:38,173::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-18::DEBUG::2014-06-04 11:05:38,499::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:05:38,500::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,505::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,505::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,505::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,506::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,506::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,506::misc::772::SamplingMethod::(__call__) Returning last result >Thread-18::DEBUG::2014-06-04 11:05:38,506::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,508::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-18::DEBUG::2014-06-04 11:05:38,647::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-06-04 11:05:38,648::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-06-04 11:05:38,692::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/33000000100000001' (cwd None) >Thread-18::DEBUG::2014-06-04 11:05:38,813::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n'; <rc> = 0 >Thread-18::INFO::2014-06-04 11:05:38,814::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'free', 'vendorID': 'IET', 'capacity': '52428800000', 'fwrev': '0001', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': '', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'productID': 'VIRTUAL-DISK'}]} >Thread-18::DEBUG::2014-06-04 11:05:38,814::task::1185::TaskManager.Task::(prepare) Task=`fb641675-f27b-4380-ada2-498c64a4c3e1`::finished: {'devList': [{'status': 'free', 'fwrev': '0001', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': 'kokotice', 'port': '3260'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'productID': 'VIRTUAL-DISK', 'vendorID': 'IET', 'capacity': '52428800000', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'pvUUID': ''}]} >Thread-18::DEBUG::2014-06-04 11:05:38,815::task::595::TaskManager.Task::(_updateState) Task=`fb641675-f27b-4380-ada2-498c64a4c3e1`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-06-04 11:05:38,815::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-06-04 11:05:38,815::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-06-04 11:05:38,815::task::990::TaskManager.Task::(_decref) Task=`fb641675-f27b-4380-ada2-498c64a4c3e1`::ref 0 aborting False >Thread-19::DEBUG::2014-06-04 11:05:39,883::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-19::DEBUG::2014-06-04 11:05:39,884::task::595::TaskManager.Task::(_updateState) Task=`f18b0817-3f4c-461a-a8cc-172ea6c1b1cc`::moving from state init -> state preparing >Thread-19::INFO::2014-06-04 11:05:39,884::logUtils::44::dispatcher::(wrapper) Run and protect: createVG(vgname='831ef374-8947-47f2-938f-5ec938f4fcef', devlist=['33000000100000001'], force=False, options=None) >Thread-19::DEBUG::2014-06-04 11:05:39,886::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/33000000100000001' (cwd None) >Thread-19::DEBUG::2014-06-04 11:05:40,013::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:05:40,013::lvm::490::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,014::lvm::493::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,014::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/33000000100000001' (cwd None) >Thread-19::DEBUG::2014-06-04 11:05:40,160::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:05:40,161::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 831ef374-8947-47f2-938f-5ec938f4fcef /dev/mapper/33000000100000001' (cwd None) >Thread-19::DEBUG::2014-06-04 11:05:40,362::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:05:40,363::lvm::490::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,363::lvm::493::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,363::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,363::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,363::lvm::930::Storage.LVM::(createVG) Cache after createvg {'831ef374-8947-47f2-938f-5ec938f4fcef': Stub(name='831ef374-8947-47f2-938f-5ec938f4fcef', stale=True)} >Thread-19::DEBUG::2014-06-04 11:05:40,364::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-19::DEBUG::2014-06-04 11:05:40,364::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-19::DEBUG::2014-06-04 11:05:40,480::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-06-04 11:05:40,481::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::INFO::2014-06-04 11:05:40,481::logUtils::47::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY'} >Thread-19::DEBUG::2014-06-04 11:05:40,482::task::1185::TaskManager.Task::(prepare) Task=`f18b0817-3f4c-461a-a8cc-172ea6c1b1cc`::finished: {'uuid': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY'} >Thread-19::DEBUG::2014-06-04 11:05:40,482::task::595::TaskManager.Task::(_updateState) Task=`f18b0817-3f4c-461a-a8cc-172ea6c1b1cc`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-06-04 11:05:40,482::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-06-04 11:05:40,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-06-04 11:05:40,482::task::990::TaskManager.Task::(_decref) Task=`f18b0817-3f4c-461a-a8cc-172ea6c1b1cc`::ref 0 aborting False >Thread-20::DEBUG::2014-06-04 11:05:40,531::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-20::DEBUG::2014-06-04 11:05:40,532::task::595::TaskManager.Task::(_updateState) Task=`47ba3843-a246-431a-94d8-bfdee0d559c8`::moving from state init -> state preparing >Thread-20::INFO::2014-06-04 11:05:40,532::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', options=None) >Thread-20::DEBUG::2014-06-04 11:05:40,532::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-06-04 11:05:40,533::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-20::DEBUG::2014-06-04 11:05:40,649::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-06-04 11:05:40,650::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-20::DEBUG::2014-06-04 11:05:40,672::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-06-04 11:05:40,672::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/33000000100000001' (cwd None) >Thread-20::DEBUG::2014-06-04 11:05:40,803::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-06-04 11:05:40,803::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-20::INFO::2014-06-04 11:05:40,803::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '52076478464', 'name': '831ef374-8947-47f2-938f-5ec938f4fcef', 'vgfree': '52076478464', 'vgUUID': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', 'pvlist': [{'vendorID': 'IET', 'capacity': '52076478464', 'fwrev': '0000', 'vgUUID': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': 'kokotice', 'port': '3260'}], 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'devcapacity': '52428800000', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-20::DEBUG::2014-06-04 11:05:40,804::task::1185::TaskManager.Task::(prepare) Task=`47ba3843-a246-431a-94d8-bfdee0d559c8`::finished: {'info': {'state': 'OK', 'vgsize': '52076478464', 'name': '831ef374-8947-47f2-938f-5ec938f4fcef', 'vgfree': '52076478464', 'vgUUID': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', 'pvlist': [{'vendorID': 'IET', 'capacity': '52076478464', 'fwrev': '0000', 'vgUUID': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': 'kokotice', 'port': '3260'}], 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'pvUUID': 'TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'devcapacity': '52428800000', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-20::DEBUG::2014-06-04 11:05:40,804::task::595::TaskManager.Task::(_updateState) Task=`47ba3843-a246-431a-94d8-bfdee0d559c8`::moving from state preparing -> state finished >Thread-20::DEBUG::2014-06-04 11:05:40,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2014-06-04 11:05:40,804::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2014-06-04 11:05:40,804::task::990::TaskManager.Task::(_decref) Task=`47ba3843-a246-431a-94d8-bfdee0d559c8`::ref 0 aborting False >Thread-21::DEBUG::2014-06-04 11:05:40,855::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-21::DEBUG::2014-06-04 11:05:40,856::task::595::TaskManager.Task::(_updateState) Task=`92574691-69b2-445a-b305-5a37c417d085`::moving from state init -> state preparing >Thread-21::INFO::2014-06-04 11:05:40,856::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >Thread-21::INFO::2014-06-04 11:05:40,856::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >Thread-21::DEBUG::2014-06-04 11:05:40,856::task::1185::TaskManager.Task::(prepare) Task=`92574691-69b2-445a-b305-5a37c417d085`::finished: {'poollist': []} >Thread-21::DEBUG::2014-06-04 11:05:40,856::task::595::TaskManager.Task::(_updateState) Task=`92574691-69b2-445a-b305-5a37c417d085`::moving from state preparing -> state finished >Thread-21::DEBUG::2014-06-04 11:05:40,856::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-21::DEBUG::2014-06-04 11:05:40,857::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-21::DEBUG::2014-06-04 11:05:40,857::task::990::TaskManager.Task::(_decref) Task=`92574691-69b2-445a-b305-5a37c417d085`::ref 0 aborting False >Thread-22::DEBUG::2014-06-04 11:05:40,904::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-22::DEBUG::2014-06-04 11:05:40,904::task::595::TaskManager.Task::(_updateState) Task=`a649b2f0-d9a1-4f2e-946f-8500afbd08a3`::moving from state init -> state preparing >Thread-22::INFO::2014-06-04 11:05:40,905::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-22::DEBUG::2014-06-04 11:05:40,905::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-22::DEBUG::2014-06-04 11:05:40,905::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-22::DEBUG::2014-06-04 11:05:40,905::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-22::DEBUG::2014-06-04 11:05:40,905::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-22::DEBUG::2014-06-04 11:05:40,906::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-22::DEBUG::2014-06-04 11:05:40,906::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-22::DEBUG::2014-06-04 11:05:40,921::misc::772::SamplingMethod::(__call__) Returning last result >Thread-22::DEBUG::2014-06-04 11:05:40,921::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-22::DEBUG::2014-06-04 11:05:41,171::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-06-04 11:05:41,171::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,172::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,172::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,172::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,172::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,172::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,173::misc::772::SamplingMethod::(__call__) Returning last result >Thread-22::DEBUG::2014-06-04 11:05:41,173::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,174::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-22::DEBUG::2014-06-04 11:05:41,296::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-06-04 11:05:41,296::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-22::DEBUG::2014-06-04 11:05:41,324::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/33000000100000001' (cwd None) >Thread-22::DEBUG::2014-06-04 11:05:41,443::lvm::295::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/33000000100000001" of volume group "831ef374-8947-47f2-938f-5ec938f4fcef" without -ff\n'; <rc> = 5 >Thread-22::DEBUG::2014-06-04 11:05:41,445::lvm::859::Storage.LVM::(testPVCreate) rc: 5, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/33000000100000001" of volume group "831ef374-8947-47f2-938f-5ec938f4fcef" without -ff'], unusedDevs: set([]), usedDevs: set(['/dev/mapper/33000000100000001']) >Thread-22::INFO::2014-06-04 11:05:41,445::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'IET', 'capacity': '52428800000', 'fwrev': '0001', 'vgUUID': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'pvUUID': 'TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'productID': 'VIRTUAL-DISK'}]} >Thread-22::DEBUG::2014-06-04 11:05:41,445::task::1185::TaskManager.Task::(prepare) Task=`a649b2f0-d9a1-4f2e-946f-8500afbd08a3`::finished: {'devList': [{'status': 'used', 'fwrev': '0001', 'vgUUID': 'wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', 'pathlist': [{'initiatorname': 'default', 'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': 'kokotice', 'port': '3260'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '4096', 'serial': 'SIET_VIRTUAL-DISK', 'GUID': '33000000100000001', 'productID': 'VIRTUAL-DISK', 'vendorID': 'IET', 'capacity': '52428800000', 'pathstatus': [{'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'pvUUID': 'TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr'}]} >Thread-22::DEBUG::2014-06-04 11:05:41,446::task::595::TaskManager.Task::(_updateState) Task=`a649b2f0-d9a1-4f2e-946f-8500afbd08a3`::moving from state preparing -> state finished >Thread-22::DEBUG::2014-06-04 11:05:41,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-22::DEBUG::2014-06-04 11:05:41,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-22::DEBUG::2014-06-04 11:05:41,446::task::990::TaskManager.Task::(_decref) Task=`a649b2f0-d9a1-4f2e-946f-8500afbd08a3`::ref 0 aborting False >Thread-23::DEBUG::2014-06-04 11:05:41,502::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-23::DEBUG::2014-06-04 11:05:41,503::task::595::TaskManager.Task::(_updateState) Task=`3826943f-f345-442b-a779-98efb1fa8c86`::moving from state init -> state preparing >Thread-23::INFO::2014-06-04 11:05:41,503::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', domainName='hosted_storage', typeSpecificArg='wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', domClass=1, domVersion=3, options=None) >Thread-23::ERROR::2014-06-04 11:05:41,503::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-23::ERROR::2014-06-04 11:05:41,503::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-23::DEBUG::2014-06-04 11:05:41,504::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:41,504::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:41,614::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:41,616::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::ERROR::2014-06-04 11:05:41,618::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 831ef374-8947-47f2-938f-5ec938f4fcef not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('831ef374-8947-47f2-938f-5ec938f4fcef',) >Thread-23::INFO::2014-06-04 11:05:41,619::blockSD::492::Storage.StorageDomain::(create) sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef domainName=hosted_storage domClass=1 vgUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY storageType=3 version=3 >Thread-23::DEBUG::2014-06-04 11:05:41,619::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:41,619::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:41,736::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:41,738::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:41,738::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:41,739::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:41,851::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:41,852::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-23::DEBUG::2014-06-04 11:05:41,852::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-23::INFO::2014-06-04 11:05:41,852::blockSD::476::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-23::DEBUG::2014-06-04 11:05:41,853::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,012::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,013::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,013::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,013::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,013::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,014::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,014::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,130::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,131::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-23::DEBUG::2014-06-04 11:05:42,131::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,131::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,132::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,244::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,245::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::INFO::2014-06-04 11:05:42,246::blockSD::665::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/33000000100000001'] >Thread-23::DEBUG::2014-06-04 11:05:42,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,398::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,399::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,399::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,399::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,399::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,400::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,410::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,416::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,569::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,569::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,569::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,570::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,570::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,570::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/831ef374-8947-47f2-938f-5ec938f4fcef/ids' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,581::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,582::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,740::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,741::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,741::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,741::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,742::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,742::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:42,898::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:42,899::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,899::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,899::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,900::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:42,900::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:43,059::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:43,059::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:43,059::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:43,060::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:43,060::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:43,060::lvm::1079::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:43,072::lvm::1079::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:43,073::blockSD::1352::Storage.Misc.excCmd::(_createVMSfs) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:48,326::blockSD::1352::Storage.Misc.excCmd::(_createVMSfs) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:48,358::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:48,479::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:48,480::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:48,480::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:48,483::blockSD::544::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:52,255::blockSD::544::Storage.Misc.excCmd::(create) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 3.75713 s, 11.2 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:52,255::misc::287::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 3.75713 s, 11.2 MB/s'], size: 41943040 >Thread-23::DEBUG::2014-06-04 11:05:52,258::blockSD::546::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:52,356::blockSD::546::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0924375 s, 11.1 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:52,356::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.0924375 s, 11.1 MB/s'], size: 1024000 >Thread-23::DEBUG::2014-06-04 11:05:52,359::blockSD::548::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:52,456::blockSD::548::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0928809 s, 11.0 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:52,456::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.0928809 s, 11.0 MB/s'], size: 1024000 >Thread-23::DEBUG::2014-06-04 11:05:52,457::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-23::DEBUG::2014-06-04 11:05:52,457::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,458::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:52,574::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:52,576::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,576::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,577::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,577::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,577::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,577::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,578::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:52,689::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:52,690::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,690::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-23::WARNING::2014-06-04 11:05:52,691::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-23::DEBUG::2014-06-04 11:05:52,691::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-23::DEBUG::2014-06-04 11:05:52,691::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-23::DEBUG::2014-06-04 11:05:52,691::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', 'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'ROLE=Regular', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', '_SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797'] >Thread-23::DEBUG::2014-06-04 11:05:52,691::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,692::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,692::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,692::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,692::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,693::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:52,806::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:52,808::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:52,808::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_ROLE=Regular, MDT_PV0=pv:33000000100000001&44&uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr&44&pestart:0&44&pecount:388&44&mapoffset:0, MDT_POOL_UUID=, MDT_LEASERETRIES=3, MDT_CLASS=Data, MDT_IOOPTIMEOUTSEC=10, MDT_LOCKRENEWALINTERVALSEC=5, MDT_TYPE=ISCSI, MDT_LOGBLKSIZE=512, MDT_LEASETIMESEC=60, MDT_SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef, MDT_VERSION=3, MDT_DESCRIPTION=hosted_storage, MDT__SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797, MDT_VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY, MDT_PHYBLKSIZE=4096, MDT_LOCKPOLICY= removing= >Thread-23::DEBUG::2014-06-04 11:05:52,809::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_LEASETIMESEC=60 --addtag MDT_PHYBLKSIZE=4096 --addtag MDT_ROLE=Regular --addtag MDT_VERSION=3 --addtag MDT_TYPE=ISCSI --addtag MDT__SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797 --addtag MDT_LOGBLKSIZE=512 --addtag MDT_DESCRIPTION=hosted_storage --addtag MDT_LEASERETRIES=3 --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_LOCKPOLICY= --addtag MDT_POOL_UUID= --addtag MDT_VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY --addtag MDT_PV0=pv:33000000100000001&44&uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr&44&pestart:0&44&pecount:388&44&mapoffset:0 --addtag MDT_CLASS=Data --addtag MDT_SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:53,026::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:53,026::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,027::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,027::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-23::DEBUG::2014-06-04 11:05:53,027::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:53,235::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:53,235::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,236::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,236::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-23::DEBUG::2014-06-04 11:05:53,239::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:53,243::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00074104 s, 2.8 MB/s\n'; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:53,244::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00074104 s, 2.8 MB/s'], size: 2048 >Thread-23::DEBUG::2014-06-04 11:05:53,244::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-23::WARNING::2014-06-04 11:05:53,244::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-23::DEBUG::2014-06-04 11:05:53,244::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-23::DEBUG::2014-06-04 11:05:53,245::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,245::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,245::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,245::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,246::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:53,364::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:53,365::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,365::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', '_SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef'] >Thread-23::DEBUG::2014-06-04 11:05:53,366::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >Thread-23::DEBUG::2014-06-04 11:05:53,571::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-23::DEBUG::2014-06-04 11:05:53,572::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,572::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-23::DEBUG::2014-06-04 11:05:53,573::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS' >Thread-23::DEBUG::2014-06-04 11:05:53,573::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS' >Thread-23::DEBUG::2014-06-04 11:05:53,573::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS' >Thread-23::DEBUG::2014-06-04 11:05:53,574::clusterlock::144::initSANLock::(initSANLock) Initializing SANLock for domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-23::DEBUG::2014-06-04 11:05:54,788::sd::424::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-23::DEBUG::2014-06-04 11:05:54,789::hsm::2636::Storage.HSM::(createStorageDomain) knownSDs: {831ef374-8947-47f2-938f-5ec938f4fcef: storage.blockSD.findDomain} >Thread-23::INFO::2014-06-04 11:05:54,789::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-23::DEBUG::2014-06-04 11:05:54,789::task::1185::TaskManager.Task::(prepare) Task=`3826943f-f345-442b-a779-98efb1fa8c86`::finished: None >Thread-23::DEBUG::2014-06-04 11:05:54,790::task::595::TaskManager.Task::(_updateState) Task=`3826943f-f345-442b-a779-98efb1fa8c86`::moving from state preparing -> state finished >Thread-23::DEBUG::2014-06-04 11:05:54,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-23::DEBUG::2014-06-04 11:05:54,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-23::DEBUG::2014-06-04 11:05:54,790::task::990::TaskManager.Task::(_decref) Task=`3826943f-f345-442b-a779-98efb1fa8c86`::ref 0 aborting False >Thread-24::DEBUG::2014-06-04 11:05:54,839::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-24::DEBUG::2014-06-04 11:05:54,840::task::595::TaskManager.Task::(_updateState) Task=`6e5cf748-8e92-4e81-8fb6-dbd792f746c6`::moving from state init -> state preparing >Thread-24::INFO::2014-06-04 11:05:54,840::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-24::INFO::2014-06-04 11:05:54,840::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-24::DEBUG::2014-06-04 11:05:54,840::task::1185::TaskManager.Task::(prepare) Task=`6e5cf748-8e92-4e81-8fb6-dbd792f746c6`::finished: {} >Thread-24::DEBUG::2014-06-04 11:05:54,840::task::595::TaskManager.Task::(_updateState) Task=`6e5cf748-8e92-4e81-8fb6-dbd792f746c6`::moving from state preparing -> state finished >Thread-24::DEBUG::2014-06-04 11:05:54,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2014-06-04 11:05:54,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2014-06-04 11:05:54,841::task::990::TaskManager.Task::(_decref) Task=`6e5cf748-8e92-4e81-8fb6-dbd792f746c6`::ref 0 aborting False >Thread-25::DEBUG::2014-06-04 11:05:54,889::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-25::DEBUG::2014-06-04 11:05:54,890::task::595::TaskManager.Task::(_updateState) Task=`94c1de76-23c2-40ed-8acd-85e23a99d88a`::moving from state init -> state preparing >Thread-25::INFO::2014-06-04 11:05:54,890::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', options=None) >Thread-25::DEBUG::2014-06-04 11:05:54,890::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`50d03320-8daa-4d81-ad43-f0ff424b304c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2775' at 'getStorageDomainStats' >Thread-25::DEBUG::2014-06-04 11:05:54,890::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-25::DEBUG::2014-06-04 11:05:54,891::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-25::DEBUG::2014-06-04 11:05:54,891::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`50d03320-8daa-4d81-ad43-f0ff424b304c`::Granted request >Thread-25::DEBUG::2014-06-04 11:05:54,891::task::827::TaskManager.Task::(resourceAcquired) Task=`94c1de76-23c2-40ed-8acd-85e23a99d88a`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-25::DEBUG::2014-06-04 11:05:54,891::task::990::TaskManager.Task::(_decref) Task=`94c1de76-23c2-40ed-8acd-85e23a99d88a`::ref 1 aborting False >Thread-25::DEBUG::2014-06-04 11:05:54,892::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-25::DEBUG::2014-06-04 11:05:54,893::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-25::DEBUG::2014-06-04 11:05:54,893::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-25::DEBUG::2014-06-04 11:05:54,893::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-25::DEBUG::2014-06-04 11:05:54,893::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-25::DEBUG::2014-06-04 11:05:54,896::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-25::DEBUG::2014-06-04 11:05:54,901::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000804057 s, 2.5 MB/s\n'; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:05:54,901::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000804057 s, 2.5 MB/s'], size: 2048 >Thread-25::DEBUG::2014-06-04 11:05:54,901::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-25::WARNING::2014-06-04 11:05:54,902::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-25::DEBUG::2014-06-04 11:05:54,902::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-25::DEBUG::2014-06-04 11:05:54,902::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-25::DEBUG::2014-06-04 11:05:54,903::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-25::DEBUG::2014-06-04 11:05:55,017::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:05:55,019::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-25::INFO::2014-06-04 11:05:55,019::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '47915728896', 'disktotal': '52076478464', 'mdafree': '67104768'}} >Thread-25::DEBUG::2014-06-04 11:05:55,019::task::1185::TaskManager.Task::(prepare) Task=`94c1de76-23c2-40ed-8acd-85e23a99d88a`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '47915728896', 'disktotal': '52076478464', 'mdafree': '67104768'}} >Thread-25::DEBUG::2014-06-04 11:05:55,020::task::595::TaskManager.Task::(_updateState) Task=`94c1de76-23c2-40ed-8acd-85e23a99d88a`::moving from state preparing -> state finished >Thread-25::DEBUG::2014-06-04 11:05:55,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-25::DEBUG::2014-06-04 11:05:55,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-25::DEBUG::2014-06-04 11:05:55,020::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-25::DEBUG::2014-06-04 11:05:55,020::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-25::DEBUG::2014-06-04 11:05:55,021::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-25::DEBUG::2014-06-04 11:05:55,021::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-25::DEBUG::2014-06-04 11:05:55,021::task::990::TaskManager.Task::(_decref) Task=`94c1de76-23c2-40ed-8acd-85e23a99d88a`::ref 0 aborting False >Thread-26::DEBUG::2014-06-04 11:05:55,070::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-26::DEBUG::2014-06-04 11:05:55,071::task::595::TaskManager.Task::(_updateState) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::moving from state init -> state preparing >Thread-26::INFO::2014-06-04 11:05:55,071::logUtils::44::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', poolName='hosted_datacenter', masterDom='831ef374-8947-47f2-938f-5ec938f4fcef', domList=['831ef374-8947-47f2-938f-5ec938f4fcef'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=None, leaseTimeSec=None, ioOpTimeoutSec=None, leaseRetries=None, options=None) >Thread-26::DEBUG::2014-06-04 11:05:55,071::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,072::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,072::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,072::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,072::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,073::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,181::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,182::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,182::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', '_SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef'] >Thread-26::INFO::2014-06-04 11:05:55,183::blockSD::851::Storage.StorageDomain::(validate) sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::DEBUG::2014-06-04 11:05:55,183::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,295::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,296::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,296::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,296::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,296::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,297::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,297::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,408::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,410::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,410::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', '_SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef'] >Thread-26::DEBUG::2014-06-04 11:05:55,411::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`7e06e619-a579-4311-b3a1-9916a2a440bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '969' at 'createStoragePool' >Thread-26::DEBUG::2014-06-04 11:05:55,411::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-26::DEBUG::2014-06-04 11:05:55,411::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >Thread-26::DEBUG::2014-06-04 11:05:55,412::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`7e06e619-a579-4311-b3a1-9916a2a440bd`::Granted request >Thread-26::DEBUG::2014-06-04 11:05:55,412::task::827::TaskManager.Task::(resourceAcquired) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (exclusive) >Thread-26::DEBUG::2014-06-04 11:05:55,412::task::990::TaskManager.Task::(_decref) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::ref 1 aborting False >Thread-26::DEBUG::2014-06-04 11:05:55,412::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`3909c303-5891-460b-94d3-c3345dc640e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '971' at 'createStoragePool' >Thread-26::DEBUG::2014-06-04 11:05:55,419::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'exclusive' >Thread-26::DEBUG::2014-06-04 11:05:55,419::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'exclusive' (1 active user) >Thread-26::DEBUG::2014-06-04 11:05:55,419::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`3909c303-5891-460b-94d3-c3345dc640e7`::Granted request >Thread-26::DEBUG::2014-06-04 11:05:55,419::task::827::TaskManager.Task::(resourceAcquired) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (exclusive) >Thread-26::DEBUG::2014-06-04 11:05:55,420::task::990::TaskManager.Task::(_decref) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::ref 1 aborting False >Thread-26::INFO::2014-06-04 11:05:55,420::sp::133::Storage.StoragePool::(setBackend) updating pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 backend from type NoneType instance 0x7f5f9fdcb210 to type StoragePoolDiskBackend instance 0x7f5f4c0b37e8 >Thread-26::INFO::2014-06-04 11:05:55,420::sp::543::Storage.StoragePool::(create) spUUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512 poolName=hosted_datacenter master_sd=831ef374-8947-47f2-938f-5ec938f4fcef domList=['831ef374-8947-47f2-938f-5ec938f4fcef'] masterVersion=1 {'LEASETIMESEC': 60, 'LOCKPOLICY': 'ON', 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-26::INFO::2014-06-04 11:05:55,420::blockSD::851::Storage.StorageDomain::(validate) sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::DEBUG::2014-06-04 11:05:55,421::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,533::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,533::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,534::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,534::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,534::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,534::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,535::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,646::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,648::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,649::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', '_SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef'] >Thread-26::DEBUG::2014-06-04 11:05:55,649::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,649::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,649::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,649::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,650::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,650::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,759::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,761::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,761::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', '_SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef'] >Thread-26::DEBUG::2014-06-04 11:05:55,762::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-26::DEBUG::2014-06-04 11:05:55,762::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-26::DEBUG::2014-06-04 11:05:55,762::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=4096', 'POOL_UUID=', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'ROLE=Regular', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', '_SHA_CKSUM=74a7d7396f4951a383e0573fd5d96afdc032a1a3'] >Thread-26::DEBUG::2014-06-04 11:05:55,762::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,763::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,763::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,763::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,763::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,764::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:55,877::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:55,878::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:55,879::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_LOCKPOLICY=ON, MDT__SHA_CKSUM=74a7d7396f4951a383e0573fd5d96afdc032a1a3 removing=MDT__SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797, MDT_LOCKPOLICY= >Thread-26::DEBUG::2014-06-04 11:05:55,879::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_LOCKPOLICY= --deltag MDT__SHA_CKSUM=aeee51285b5eec0653efa491de3c29fdf182e797 --addtag MDT__SHA_CKSUM=74a7d7396f4951a383e0573fd5d96afdc032a1a3 --addtag MDT_LOCKPOLICY=ON 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:05:56,102::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:05:56,103::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:56,103::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:05:56,103::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-26::INFO::2014-06-04 11:05:56,103::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 250) >Thread-26::DEBUG::2014-06-04 11:06:17,106::clusterlock::202::SANLock::(acquireHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully acquired (id: 250) >Thread-26::WARNING::2014-06-04 11:06:17,106::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images already exists >Thread-26::WARNING::2014-06-04 11:06:17,107::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/dom_md already exists >Thread-26::DEBUG::2014-06-04 11:06:17,107::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,108::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,108::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,108::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,108::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-26::DEBUG::2014-06-04 11:06:17,111::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:17,116::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000854174 s, 2.4 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:17,116::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000854174 s, 2.4 MB/s'], size: 2048 >Thread-26::DEBUG::2014-06-04 11:06:17,116::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-26::WARNING::2014-06-04 11:06:17,116::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-26::DEBUG::2014-06-04 11:06:17,117::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-26::DEBUG::2014-06-04 11:06:17,117::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,117::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,118::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,118::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,118::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,119::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:17,232::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:17,233::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,234::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', '_SHA_CKSUM=74a7d7396f4951a383e0573fd5d96afdc032a1a3', 'LOCKPOLICY=ON'] >Thread-26::INFO::2014-06-04 11:06:17,234::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 250) >Thread-26::DEBUG::2014-06-04 11:06:17,526::clusterlock::261::SANLock::(acquire) Cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully acquired (id: 250) >Thread-26::INFO::2014-06-04 11:06:17,526::sp::666::Storage.StoragePool::(createMaster) setting master domain for spUUID 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 on sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::DEBUG::2014-06-04 11:06:17,527::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-26::DEBUG::2014-06-04 11:06:17,527::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-26::DEBUG::2014-06-04 11:06:17,527::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'ROLE=Regular', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', '_SHA_CKSUM=0854c5f94fd20699a462f9495000f9d82fdc2e18'] >Thread-26::DEBUG::2014-06-04 11:06:17,527::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,527::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,528::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,528::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,528::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,528::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:17,642::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:17,643::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,643::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active, MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT__SHA_CKSUM=0854c5f94fd20699a462f9495000f9d82fdc2e18, MDT_MASTER_VERSION=1, MDT_POOL_DESCRIPTION=hosted_datacenter removing=MDT__SHA_CKSUM=74a7d7396f4951a383e0573fd5d96afdc032a1a3 >Thread-26::DEBUG::2014-06-04 11:06:17,644::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=74a7d7396f4951a383e0573fd5d96afdc032a1a3 --addtag MDT_POOL_SPM_ID=-1 --addtag MDT_MASTER_VERSION=1 --addtag MDT_POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active --addtag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_DESCRIPTION=hosted_datacenter --addtag MDT__SHA_CKSUM=0854c5f94fd20699a462f9495000f9d82fdc2e18 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:17,862::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:17,862::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,862::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,862::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-26::DEBUG::2014-06-04 11:06:17,863::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,863::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,863::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,863::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,863::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,864::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:17,991::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:17,993::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,993::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', '_SHA_CKSUM=0854c5f94fd20699a462f9495000f9d82fdc2e18'] >Thread-26::DEBUG::2014-06-04 11:06:17,994::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-26::DEBUG::2014-06-04 11:06:17,994::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-26::DEBUG::2014-06-04 11:06:17,994::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-26::DEBUG::2014-06-04 11:06:17,994::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-26::DEBUG::2014-06-04 11:06:17,994::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-26::DEBUG::2014-06-04 11:06:17,995::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'ROLE=Master', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914'] >Thread-26::DEBUG::2014-06-04 11:06:17,995::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,995::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,995::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,996::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,996::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:17,996::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:18,109::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:18,110::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,111::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_ROLE=Master, MDT_POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512, MDT__SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914 removing=MDT_POOL_UUID=, MDT__SHA_CKSUM=0854c5f94fd20699a462f9495000f9d82fdc2e18, MDT_ROLE=Regular >Thread-26::DEBUG::2014-06-04 11:06:18,112::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_UUID= --deltag MDT_ROLE=Regular --deltag MDT__SHA_CKSUM=0854c5f94fd20699a462f9495000f9d82fdc2e18 --addtag MDT_ROLE=Master --addtag MDT__SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914 --addtag MDT_POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:18,331::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:18,331::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,332::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,332::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-26::DEBUG::2014-06-04 11:06:18,332::sp::1366::Storage.StoragePool::(setMasterDomain) Master domain 831ef374-8947-47f2-938f-5ec938f4fcef verified, version 1 >Thread-26::DEBUG::2014-06-04 11:06:18,332::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-26::DEBUG::2014-06-04 11:06:18,332::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-26::DEBUG::2014-06-04 11:06:18,333::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,333::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,333::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,333::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,334::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,334::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:18,451::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:18,452::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,453::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >Thread-26::INFO::2014-06-04 11:06:18,453::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::DEBUG::2014-06-04 11:06:18,454::sp::1395::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `32dab0ff-9eaa-41c7-ae50-4e6ef6355512` started monitoring domain `831ef374-8947-47f2-938f-5ec938f4fcef` >Thread-27::DEBUG::2014-06-04 11:06:18,454::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::DEBUG::2014-06-04 11:06:18,455::misc::772::SamplingMethod::(__call__) Returning last result >Thread-26::WARNING::2014-06-04 11:06:18,456::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512 already exists >Thread-27::DEBUG::2014-06-04 11:06:18,459::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:18,464::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,473::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,473::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,474::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,474::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,474::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-27::DEBUG::2014-06-04 11:06:18,569::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-27::DEBUG::2014-06-04 11:06:18,572::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-26::DEBUG::2014-06-04 11:06:18,583::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:18,586::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-27::DEBUG::2014-06-04 11:06:18,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00662663 s, 618 kB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:18,588::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >Thread-26::DEBUG::2014-06-04 11:06:18,589::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-26::DEBUG::2014-06-04 11:06:18,593::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-27::DEBUG::2014-06-04 11:06:18,599::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 831ef374-8947-47f2-938f-5ec938f4fcef changed its status to Valid >Thread-26::DEBUG::2014-06-04 11:06:18,710::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-26::DEBUG::2014-06-04 11:06:18,711::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-26::WARNING::2014-06-04 11:06:18,711::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images already exists >Thread-26::WARNING::2014-06-04 11:06:18,711::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/dom_md already exists >Thread-26::INFO::2014-06-04 11:06:18,711::sp::1104::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef to /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::INFO::2014-06-04 11:06:18,712::sp::1104::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef to /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd >Thread-26::INFO::2014-06-04 11:06:18,712::clusterlock::279::SANLock::(release) Releasing cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-26::DEBUG::2014-06-04 11:06:18,740::clusterlock::289::SANLock::(release) Cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully released >Thread-26::INFO::2014-06-04 11:06:18,741::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 250) >Thread-26::DEBUG::2014-06-04 11:06:20,741::clusterlock::217::SANLock::(releaseHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef released successfully (id: 250) >Thread-26::INFO::2014-06-04 11:06:20,741::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-27::DEBUG::2014-06-04 11:06:20,742::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-27::INFO::2014-06-04 11:06:20,742::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 250) >Thread-27::DEBUG::2014-06-04 11:06:20,742::clusterlock::217::SANLock::(releaseHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef released successfully (id: 250) >Thread-26::INFO::2014-06-04 11:06:20,742::logUtils::47::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-26::DEBUG::2014-06-04 11:06:20,743::task::1185::TaskManager.Task::(prepare) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::finished: True >Thread-26::DEBUG::2014-06-04 11:06:20,743::task::595::TaskManager.Task::(_updateState) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::moving from state preparing -> state finished >Thread-26::DEBUG::2014-06-04 11:06:20,743::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>, 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-26::DEBUG::2014-06-04 11:06:20,743::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26::DEBUG::2014-06-04 11:06:20,743::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-26::DEBUG::2014-06-04 11:06:20,743::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-26::DEBUG::2014-06-04 11:06:20,744::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-26::DEBUG::2014-06-04 11:06:20,744::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-26::DEBUG::2014-06-04 11:06:20,744::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-26::DEBUG::2014-06-04 11:06:20,744::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-26::DEBUG::2014-06-04 11:06:20,744::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-26::DEBUG::2014-06-04 11:06:20,744::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-26::DEBUG::2014-06-04 11:06:20,745::task::990::TaskManager.Task::(_decref) Task=`930eef20-c008-453a-8682-6e7ab5ff5c19`::ref 0 aborting False >Thread-28::DEBUG::2014-06-04 11:06:20,793::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-28::DEBUG::2014-06-04 11:06:20,794::task::595::TaskManager.Task::(_updateState) Task=`cc6ff55c-829a-49bb-ae19-840cd83aa0ed`::moving from state init -> state preparing >Thread-28::INFO::2014-06-04 11:06:20,794::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', hostID=1, msdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', masterVersion=1, domainsMap=None, options=None) >Thread-28::DEBUG::2014-06-04 11:06:20,794::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`c368e604-34f9-43c3-b3be-c6d9c1a32539`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1007' at 'connectStoragePool' >Thread-28::DEBUG::2014-06-04 11:06:20,794::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-28::DEBUG::2014-06-04 11:06:20,795::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-28::DEBUG::2014-06-04 11:06:20,795::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`c368e604-34f9-43c3-b3be-c6d9c1a32539`::Granted request >Thread-28::DEBUG::2014-06-04 11:06:20,795::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`a074eecf-079e-4c8c-86a0-af8916fb5530`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1055' at '_connectStoragePool' >Thread-28::DEBUG::2014-06-04 11:06:20,795::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-28::DEBUG::2014-06-04 11:06:20,795::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >Thread-28::DEBUG::2014-06-04 11:06:20,796::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`a074eecf-079e-4c8c-86a0-af8916fb5530`::Granted request >Thread-28::INFO::2014-06-04 11:06:20,796::sp::133::Storage.StoragePool::(setBackend) updating pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 backend from type NoneType instance 0x7f5f9fdcb210 to type StoragePoolDiskBackend instance 0x7f5f4004c1b8 >Thread-28::INFO::2014-06-04 11:06:20,796::sp::618::Storage.StoragePool::(connect) Connect host #1 to the storage pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 with master domain: 831ef374-8947-47f2-938f-5ec938f4fcef (ver = 1) >Thread-28::DEBUG::2014-06-04 11:06:20,796::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:20,796::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:20,797::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:20,797::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:20,797::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:20,797::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:20,797::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-28::DEBUG::2014-06-04 11:06:20,797::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-28::DEBUG::2014-06-04 11:06:20,798::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-28::DEBUG::2014-06-04 11:06:20,798::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-28::DEBUG::2014-06-04 11:06:20,798::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-28::DEBUG::2014-06-04 11:06:20,798::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:20,812::misc::772::SamplingMethod::(__call__) Returning last result >Thread-28::DEBUG::2014-06-04 11:06:20,812::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,052::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,053::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,058::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,059::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,059::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,059::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,059::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,059::misc::772::SamplingMethod::(__call__) Returning last result >Thread-28::DEBUG::2014-06-04 11:06:21,060::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,061::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,174::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,175::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,175::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:06:21,177::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,181::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000790966 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,182::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000790966 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 11:06:21,182::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 11:06:21,182::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 11:06:21,182::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:06:21,183::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,183::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,183::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,183::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,183::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,184::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,295::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,297::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,297::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >Thread-28::INFO::2014-06-04 11:06:21,298::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 11:06:21,298::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 11:06:21,298::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 11:06:21,299::sp::1366::Storage.StoragePool::(setMasterDomain) Master domain 831ef374-8947-47f2-938f-5ec938f4fcef verified, version 1 >Thread-28::DEBUG::2014-06-04 11:06:21,299::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-28::DEBUG::2014-06-04 11:06:21,299::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-28::DEBUG::2014-06-04 11:06:21,299::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,300::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,300::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,300::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,300::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,301::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,413::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,414::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,415::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >Thread-28::INFO::2014-06-04 11:06:21,415::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-29::DEBUG::2014-06-04 11:06:21,416::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 11:06:21,416::sp::1395::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `32dab0ff-9eaa-41c7-ae50-4e6ef6355512` started monitoring domain `831ef374-8947-47f2-938f-5ec938f4fcef` >Thread-28::DEBUG::2014-06-04 11:06:21,417::misc::772::SamplingMethod::(__call__) Returning last result >Thread-28::WARNING::2014-06-04 11:06:21,418::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512 already exists >Thread-28::DEBUG::2014-06-04 11:06:21,420::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-29::DEBUG::2014-06-04 11:06:21,420::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,437::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,438::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,438::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,438::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,438::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-29::DEBUG::2014-06-04 11:06:21,541::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:06:21,543::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,549::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,553::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,555::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >Thread-29::DEBUG::2014-06-04 11:06:21,556::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000924314 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,558::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:06:21,563::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-29::DEBUG::2014-06-04 11:06:21,569::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 831ef374-8947-47f2-938f-5ec938f4fcef changed its status to Valid >Thread-30::DEBUG::2014-06-04 11:06:21,570::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-29::INFO::2014-06-04 11:06:21,570::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 1) >Thread-30::DEBUG::2014-06-04 11:06:21,571::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-29::DEBUG::2014-06-04 11:06:21,572::clusterlock::202::SANLock::(acquireHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully acquired (id: 1) >Thread-30::DEBUG::2014-06-04 11:06:21,577::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-31::INFO::2014-06-04 11:06:21,579::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-28::DEBUG::2014-06-04 11:06:21,680::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:21,681::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::WARNING::2014-06-04 11:06:21,681::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images already exists >Thread-28::WARNING::2014-06-04 11:06:21,682::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/dom_md already exists >Thread-28::INFO::2014-06-04 11:06:21,682::sp::1104::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef to /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::INFO::2014-06-04 11:06:21,682::sp::1104::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef to /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd >Thread-28::DEBUG::2014-06-04 11:06:21,682::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-28::DEBUG::2014-06-04 11:06:21,684::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:21,691::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00340159 s, 1.2 MB/s\n'; <rc> = 0 >Thread-28::INFO::2014-06-04 11:06:21,692::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-28::DEBUG::2014-06-04 11:06:21,692::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-28::DEBUG::2014-06-04 11:06:22,697::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00133 s, 4.1 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:06:22,698::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 >Thread-28::DEBUG::2014-06-04 11:06:22,698::sp::460::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 on master domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 11:06:22,698::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-28::DEBUG::2014-06-04 11:06:22,699::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-28::DEBUG::2014-06-04 11:06:22,699::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-28::DEBUG::2014-06-04 11:06:22,699::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-28::DEBUG::2014-06-04 11:06:22,699::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-28::DEBUG::2014-06-04 11:06:22,700::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-28::DEBUG::2014-06-04 11:06:22,700::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-28::DEBUG::2014-06-04 11:06:22,700::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-28::INFO::2014-06-04 11:06:22,700::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-28::DEBUG::2014-06-04 11:06:22,700::task::1185::TaskManager.Task::(prepare) Task=`cc6ff55c-829a-49bb-ae19-840cd83aa0ed`::finished: True >Thread-28::DEBUG::2014-06-04 11:06:22,700::task::595::TaskManager.Task::(_updateState) Task=`cc6ff55c-829a-49bb-ae19-840cd83aa0ed`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-06-04 11:06:22,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-06-04 11:06:22,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-28::DEBUG::2014-06-04 11:06:22,701::task::990::TaskManager.Task::(_decref) Task=`cc6ff55c-829a-49bb-ae19-840cd83aa0ed`::ref 0 aborting False >Thread-38::DEBUG::2014-06-04 11:06:22,750::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-38::DEBUG::2014-06-04 11:06:22,751::task::595::TaskManager.Task::(_updateState) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::moving from state init -> state preparing >Thread-38::INFO::2014-06-04 11:06:22,751::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', prevID=-1, prevLVER=-1, maxHostID=250, domVersion=3, options=None) >Thread-38::DEBUG::2014-06-04 11:06:22,752::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`bbc1ce0f-d667-4257-8d7b-de59ff5c000e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '577' at 'spmStart' >Thread-38::DEBUG::2014-06-04 11:06:22,752::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-38::DEBUG::2014-06-04 11:06:22,752::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >Thread-38::DEBUG::2014-06-04 11:06:22,752::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`bbc1ce0f-d667-4257-8d7b-de59ff5c000e`::Granted request >Thread-38::DEBUG::2014-06-04 11:06:22,753::task::827::TaskManager.Task::(resourceAcquired) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (exclusive) >Thread-38::DEBUG::2014-06-04 11:06:22,753::task::990::TaskManager.Task::(_decref) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::ref 1 aborting False >Thread-38::INFO::2014-06-04 11:06:22,754::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-38::DEBUG::2014-06-04 11:06:22,754::task::1180::TaskManager.Task::(prepare) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::Prepare: 1 jobs exist, move to acquiring >Thread-38::DEBUG::2014-06-04 11:06:22,754::task::595::TaskManager.Task::(_updateState) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::moving from state preparing -> state acquiring >Thread-38::DEBUG::2014-06-04 11:06:22,754::task::595::TaskManager.Task::(_updateState) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::moving from state acquiring -> state queued >Thread-38::DEBUG::2014-06-04 11:06:22,754::taskManager::50::TaskManager::(_queueTask) queuing task: 58918f9e-ff1c-46ba-9e44-7ac4272981b0 >Thread-38::DEBUG::2014-06-04 11:06:22,754::taskManager::56::TaskManager::(_queueTask) task queued: 58918f9e-ff1c-46ba-9e44-7ac4272981b0 >Thread-2::DEBUG::2014-06-04 11:06:22,755::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-38::DEBUG::2014-06-04 11:06:22,755::task::1182::TaskManager.Task::(prepare) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::returning >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,756::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 58918f9e-ff1c-46ba-9e44-7ac4272981b0 running: <bound method Task.commit of <storage.task.Task instance at 0x7f5f4c0834d0>> with: None >Thread-38::DEBUG::2014-06-04 11:06:22,756::task::990::TaskManager.Task::(_decref) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::ref 0 aborting False >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,757::task::1194::TaskManager.Task::(commit) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::committing task: 58918f9e-ff1c-46ba-9e44-7ac4272981b0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,758::task::595::TaskManager.Task::(_updateState) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::moving from state queued -> state running >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,759::task::905::TaskManager.Task::(_runJobs) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x23ef0d0>> (args: (-1, -1, 250, 3) kwargs: {}) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,759::task::331::TaskManager.Task::(run) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x23ef0d0>> (args: (-1, -1, 250, 3) kwargs: {}) callback None >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,760::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,760::misc::764::SamplingMethod::(__call__) Got in to sampling method >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,760::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,760::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,761::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,761::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,761::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,762::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-39::DEBUG::2014-06-04 11:06:22,807::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-39::DEBUG::2014-06-04 11:06:22,808::task::595::TaskManager.Task::(_updateState) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::moving from state init -> state preparing >Thread-39::INFO::2014-06-04 11:06:22,808::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', options=None) >Thread-39::DEBUG::2014-06-04 11:06:22,808::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`bcca36cd-ecf2-48e0-94f1-ffe92d8d8483`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1245' at 'activateStorageDomain' >Thread-39::DEBUG::2014-06-04 11:06:22,808::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-39::DEBUG::2014-06-04 11:06:22,809::resourceManager::577::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is currently locked, Entering queue (1 in queue) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,875::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,876::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,877::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:22,877::misc::772::SamplingMethod::(__call__) Returning last result >58918f9e-ff1c-46ba-9e44-7ac4272981b0::INFO::2014-06-04 11:06:22,969::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 1) >Thread-29::DEBUG::2014-06-04 11:06:31,575::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-29::DEBUG::2014-06-04 11:06:31,580::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109643 s, 3.7 MB/s\n'; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,971::clusterlock::202::SANLock::(acquireHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully acquired (id: 1) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::WARNING::2014-06-04 11:06:42,971::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images already exists >58918f9e-ff1c-46ba-9e44-7ac4272981b0::WARNING::2014-06-04 11:06:42,971::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/dom_md already exists >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,972::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,972::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,972::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,972::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,973::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,975::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,980::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000866186 s, 2.4 MB/s\n'; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,980::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000866186 s, 2.4 MB/s'], size: 2048 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,981::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::WARNING::2014-06-04 11:06:42,981::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,981::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,981::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,981::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,982::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,982::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,982::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:42,983::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,101::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,103::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,103::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::INFO::2014-06-04 11:06:43,104::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 1) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,405::clusterlock::261::SANLock::(acquire) Cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully acquired (id: 1) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,405::sp::266::Storage.StoragePool::(startSpm) spm lock acquired successfully >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,405::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,405::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,405::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,406::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,406::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,406::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,518::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,519::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,519::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'POOL_SPM_ID=-1', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_LVER=-1', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', '_SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,520::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,520::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,520::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'ROLE=Master', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', '_SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,521::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,521::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,521::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,521::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,522::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,522::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,634::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,635::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,636::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511, MDT_POOL_SPM_LVER=0, MDT_POOL_SPM_ID=1 removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT__SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,636::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=5e70c2ffad53dd53f1c3d6a6432b363dd65aa914 --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511 --addtag MDT_POOL_SPM_LVER=0 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,859::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,859::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,860::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,860::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,860::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`4db92bcb-47db-4af7-a6f4-1ff27be6818f`::Request was made in '/usr/share/vdsm/storage/sp.py' line '425' at '_upgradePool' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,861::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,861::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,861::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`4db92bcb-47db-4af7-a6f4-1ff27be6818f`::Granted request >58918f9e-ff1c-46ba-9e44-7ac4272981b0::INFO::2014-06-04 11:06:43,862::sp::431::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `831ef374-8947-47f2-938f-5ec938f4fcef` >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,862::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`98ff3dea-10d7-476d-8269-43bdff9b47c5`::Request was made in '/usr/share/vdsm/storage/sp.py' line '433' at '_upgradePool' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,862::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'exclusive' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,862::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'exclusive' (1 active user) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,862::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`98ff3dea-10d7-476d-8269-43bdff9b47c5`::Granted request >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,863::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,864::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,978::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,979::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,980::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,981::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,985::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000739852 s, 2.8 MB/s\n'; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,986::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000739852 s, 2.8 MB/s'], size: 2048 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,986::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::WARNING::2014-06-04 11:06:43,986::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,986::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,987::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,987::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,987::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,987::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,988::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:43,988::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,113::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,114::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,114::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_ID=1', '_SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511', 'POOL_SPM_LVER=0'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::INFO::2014-06-04 11:06:44,115::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >58918f9e-ff1c-46ba-9e44-7ac4272981b0::INFO::2014-06-04 11:06:44,115::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >58918f9e-ff1c-46ba-9e44-7ac4272981b0::INFO::2014-06-04 11:06:44,116::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,116::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,116::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,116::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,116::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,117::sp::436::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,117::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,117::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,118::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,118::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,118::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,119::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,228::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,229::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,230::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_ID=1', '_SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511', 'POOL_SPM_LVER=0'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,230::sp::443::Storage.StoragePool::(_upgradePool) Registering with state change event >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,230::sp::446::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,230::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,231::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,231::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,231::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,232::blockSD::1137::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,331::blockSD::1137::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,331::blockSD::1162::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,362::blockSD::1162::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,362::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/831ef374-8947-47f2-938f-5ec938f4fcef/master /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,442::blockSD::1174::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,465::blockSD::1174::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,466::sd::623::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master/vms >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,562::sd::626::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master/tasks >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,564::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,565::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,565::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,565::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,565::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,566::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,682::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,684::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,684::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_ID=1', '_SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511', 'POOL_SPM_LVER=0'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,686::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,693::storage_mailbox::574::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,695::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,825::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.110735 s, 9.2 MB/s\n'; <rc> = 0 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,826::storage_mailbox::582::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,827::sp::318::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 on master domain 831ef374-8947-47f2-938f-5ec938f4fcef >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,828::sp::326::Storage.StoragePool::(startSpm) ended. >Dummy-45::DEBUG::2014-06-04 11:06:44,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,829::task::595::TaskManager.Task::(_updateState) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::moving from state running -> state finished >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,834::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,835::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,835::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,835::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,835::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,836::resourceManager::654::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' has 1 requests in queue. Handling top request. >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,836::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`bcca36cd-ecf2-48e0-94f1-ffe92d8d8483`::Granted request >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,836::resourceManager::686::ResourceManager::(releaseResource) Request 'Request for Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 - exclusive: granted' was granted >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,838::task::913::TaskManager.Task::(_runJobs) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::Task.run: exit - success: result >Thread-39::DEBUG::2014-06-04 11:06:44,838::task::827::TaskManager.Task::(resourceAcquired) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (exclusive) >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,839::task::990::TaskManager.Task::(_decref) Task=`58918f9e-ff1c-46ba-9e44-7ac4272981b0`::ref 0 aborting False >Thread-39::DEBUG::2014-06-04 11:06:44,839::task::990::TaskManager.Task::(_decref) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::ref 1 aborting False >58918f9e-ff1c-46ba-9e44-7ac4272981b0::DEBUG::2014-06-04 11:06:44,840::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-39::DEBUG::2014-06-04 11:06:44,841::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`9267b491-40d9-483a-8e12-c02e6bb8165e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1246' at 'activateStorageDomain' >Thread-39::DEBUG::2014-06-04 11:06:44,841::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'exclusive' >Thread-39::DEBUG::2014-06-04 11:06:44,842::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'exclusive' (1 active user) >Thread-39::DEBUG::2014-06-04 11:06:44,842::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`9267b491-40d9-483a-8e12-c02e6bb8165e`::Granted request >Thread-39::DEBUG::2014-06-04 11:06:44,842::task::827::TaskManager.Task::(resourceAcquired) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (exclusive) >Thread-39::DEBUG::2014-06-04 11:06:44,842::task::990::TaskManager.Task::(_decref) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::ref 1 aborting False >Thread-39::INFO::2014-06-04 11:06:44,842::sp::1015::Storage.StoragePool::(activateSD) sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef spUUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512 >Thread-39::INFO::2014-06-04 11:06:44,843::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-39::DEBUG::2014-06-04 11:06:44,843::task::1185::TaskManager.Task::(prepare) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::finished: None >Thread-39::DEBUG::2014-06-04 11:06:44,843::task::595::TaskManager.Task::(_updateState) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::moving from state preparing -> state finished >Thread-39::DEBUG::2014-06-04 11:06:44,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>, 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-39::DEBUG::2014-06-04 11:06:44,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2014-06-04 11:06:44,844::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-39::DEBUG::2014-06-04 11:06:44,844::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-39::DEBUG::2014-06-04 11:06:44,844::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-39::DEBUG::2014-06-04 11:06:44,844::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-39::DEBUG::2014-06-04 11:06:44,845::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-39::DEBUG::2014-06-04 11:06:44,845::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-39::DEBUG::2014-06-04 11:06:44,845::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-39::DEBUG::2014-06-04 11:06:44,845::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-39::DEBUG::2014-06-04 11:06:44,845::task::990::TaskManager.Task::(_decref) Task=`5b0e1946-2037-405c-8dc5-8299310019ca`::ref 0 aborting False >Thread-46::DEBUG::2014-06-04 11:06:44,901::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-46::DEBUG::2014-06-04 11:06:44,902::task::595::TaskManager.Task::(_updateState) Task=`9a6fb644-307a-42c6-9967-20688726b4dc`::moving from state init -> state preparing >Thread-46::INFO::2014-06-04 11:06:44,902::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-46::DEBUG::2014-06-04 11:06:44,902::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-46::DEBUG::2014-06-04 11:06:44,902::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-46::INFO::2014-06-04 11:06:44,903::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-46::DEBUG::2014-06-04 11:06:44,903::task::1185::TaskManager.Task::(prepare) Task=`9a6fb644-307a-42c6-9967-20688726b4dc`::finished: {'allTasksStatus': {}} >Thread-46::DEBUG::2014-06-04 11:06:44,903::task::595::TaskManager.Task::(_updateState) Task=`9a6fb644-307a-42c6-9967-20688726b4dc`::moving from state preparing -> state finished >Thread-46::DEBUG::2014-06-04 11:06:44,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-46::DEBUG::2014-06-04 11:06:44,903::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-06-04 11:06:44,903::task::990::TaskManager.Task::(_decref) Task=`9a6fb644-307a-42c6-9967-20688726b4dc`::ref 0 aborting False >Thread-47::DEBUG::2014-06-04 11:06:44,952::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-47::DEBUG::2014-06-04 11:06:44,953::task::595::TaskManager.Task::(_updateState) Task=`1745af2a-a1ab-4fc0-9169-addb467dcd60`::moving from state init -> state preparing >Thread-47::INFO::2014-06-04 11:06:44,954::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', options=None) >Dummy-45::DEBUG::2014-06-04 11:06:44,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108504 s, 9.4 MB/s\n'; <rc> = 0 >Thread-47::INFO::2014-06-04 11:06:45,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-47::DEBUG::2014-06-04 11:06:45,047::task::1185::TaskManager.Task::(prepare) Task=`1745af2a-a1ab-4fc0-9169-addb467dcd60`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} >Thread-47::DEBUG::2014-06-04 11:06:45,048::task::595::TaskManager.Task::(_updateState) Task=`1745af2a-a1ab-4fc0-9169-addb467dcd60`::moving from state preparing -> state finished >Thread-47::DEBUG::2014-06-04 11:06:45,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-47::DEBUG::2014-06-04 11:06:45,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-47::DEBUG::2014-06-04 11:06:45,048::task::990::TaskManager.Task::(_decref) Task=`1745af2a-a1ab-4fc0-9169-addb467dcd60`::ref 0 aborting False >Thread-48::DEBUG::2014-06-04 11:06:45,094::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-48::DEBUG::2014-06-04 11:06:45,095::task::595::TaskManager.Task::(_updateState) Task=`d2e5f443-ef3c-4aba-b775-4704ddca4fee`::moving from state init -> state preparing >Thread-48::INFO::2014-06-04 11:06:45,095::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', options=None) >Thread-48::DEBUG::2014-06-04 11:06:45,095::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`9dc1c29f-5d97-499e-bd3d-26dbc8b15a3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2561' at 'getStoragePoolInfo' >Thread-48::DEBUG::2014-06-04 11:06:45,095::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'shared' >Thread-48::DEBUG::2014-06-04 11:06:45,096::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'shared' (1 active user) >Thread-48::DEBUG::2014-06-04 11:06:45,096::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`9dc1c29f-5d97-499e-bd3d-26dbc8b15a3d`::Granted request >Thread-48::DEBUG::2014-06-04 11:06:45,096::task::827::TaskManager.Task::(resourceAcquired) Task=`d2e5f443-ef3c-4aba-b775-4704ddca4fee`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (shared) >Thread-48::DEBUG::2014-06-04 11:06:45,096::task::990::TaskManager.Task::(_decref) Task=`d2e5f443-ef3c-4aba-b775-4704ddca4fee`::ref 1 aborting False >Thread-48::INFO::2014-06-04 11:06:45,097::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'hosted_datacenter', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'master_uuid': '831ef374-8947-47f2-938f-5ec938f4fcef', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'831ef374-8947-47f2-938f-5ec938f4fcef': {'status': 'Active', 'diskfree': '47915728896', 'isoprefix': '', 'alerts': [], 'disktotal': '52076478464', 'version': 3}}} >Thread-48::DEBUG::2014-06-04 11:06:45,097::task::1185::TaskManager.Task::(prepare) Task=`d2e5f443-ef3c-4aba-b775-4704ddca4fee`::finished: {'info': {'name': 'hosted_datacenter', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'master_uuid': '831ef374-8947-47f2-938f-5ec938f4fcef', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'831ef374-8947-47f2-938f-5ec938f4fcef': {'status': 'Active', 'diskfree': '47915728896', 'isoprefix': '', 'alerts': [], 'disktotal': '52076478464', 'version': 3}}} >Thread-48::DEBUG::2014-06-04 11:06:45,097::task::595::TaskManager.Task::(_updateState) Task=`d2e5f443-ef3c-4aba-b775-4704ddca4fee`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-06-04 11:06:45,098::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-48::DEBUG::2014-06-04 11:06:45,098::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-06-04 11:06:45,098::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-48::DEBUG::2014-06-04 11:06:45,098::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-48::DEBUG::2014-06-04 11:06:45,098::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-48::DEBUG::2014-06-04 11:06:45,098::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-48::DEBUG::2014-06-04 11:06:45,098::task::990::TaskManager.Task::(_decref) Task=`d2e5f443-ef3c-4aba-b775-4704ddca4fee`::ref 0 aborting False >Thread-49::DEBUG::2014-06-04 11:06:45,147::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-49::DEBUG::2014-06-04 11:06:45,147::task::595::TaskManager.Task::(_updateState) Task=`ed6c03c5-aee6-44a0-a3d3-e870161b5ed3`::moving from state init -> state preparing >Thread-49::INFO::2014-06-04 11:06:45,148::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-49::INFO::2014-06-04 11:06:45,148::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109643', 'lastCheck': '2.2', 'valid': True}} >Thread-49::DEBUG::2014-06-04 11:06:45,148::task::1185::TaskManager.Task::(prepare) Task=`ed6c03c5-aee6-44a0-a3d3-e870161b5ed3`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109643', 'lastCheck': '2.2', 'valid': True}} >Thread-49::DEBUG::2014-06-04 11:06:45,148::task::595::TaskManager.Task::(_updateState) Task=`ed6c03c5-aee6-44a0-a3d3-e870161b5ed3`::moving from state preparing -> state finished >Thread-49::DEBUG::2014-06-04 11:06:45,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-49::DEBUG::2014-06-04 11:06:45,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-49::DEBUG::2014-06-04 11:06:45,149::task::990::TaskManager.Task::(_decref) Task=`ed6c03c5-aee6-44a0-a3d3-e870161b5ed3`::ref 0 aborting False >Thread-50::DEBUG::2014-06-04 11:06:45,323::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-50::DEBUG::2014-06-04 11:06:45,324::task::595::TaskManager.Task::(_updateState) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::moving from state init -> state preparing >Thread-50::INFO::2014-06-04 11:06:45,324::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', options=None) >Thread-50::DEBUG::2014-06-04 11:06:45,325::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`7f9c029f-2744-436e-920f-86ed636784fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3106' at 'getVolumePath' >Thread-50::DEBUG::2014-06-04 11:06:45,325::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-50::DEBUG::2014-06-04 11:06:45,325::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-50::DEBUG::2014-06-04 11:06:45,325::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`7f9c029f-2744-436e-920f-86ed636784fa`::Granted request >Thread-50::DEBUG::2014-06-04 11:06:45,326::task::827::TaskManager.Task::(resourceAcquired) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-50::DEBUG::2014-06-04 11:06:45,326::task::990::TaskManager.Task::(_decref) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::ref 1 aborting False >Thread-50::DEBUG::2014-06-04 11:06:45,326::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-50::DEBUG::2014-06-04 11:06:45,327::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-50::DEBUG::2014-06-04 11:06:45,441::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-50::DEBUG::2014-06-04 11:06:45,446::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-50::DEBUG::2014-06-04 11:06:45,446::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-50::WARNING::2014-06-04 11:06:45,446::lvm::607::Storage.LVM::(getLv) lv: 81fbcbaf-2264-4fa8-831f-da5bf9b5281b not found in lvs vg: 831ef374-8947-47f2-938f-5ec938f4fcef response >Thread-50::ERROR::2014-06-04 11:06:45,447::task::866::TaskManager.Task::(_setError) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3109, in getVolumePath > volUUID=volUUID).getVolumePath() > File "/usr/share/vdsm/storage/sd.py", line 389, in produceVolume > volUUID) > File "/usr/share/vdsm/storage/blockVolume.py", line 80, in __init__ > volume.Volume.__init__(self, repoPath, sdUUID, imgUUID, volUUID) > File "/usr/share/vdsm/storage/volume.py", line 140, in __init__ > self.validate() > File "/usr/share/vdsm/storage/blockVolume.py", line 88, in validate > raise se.VolumeDoesNotExist(self.volUUID) # Fix me >VolumeDoesNotExist: Volume does not exist: ('81fbcbaf-2264-4fa8-831f-da5bf9b5281b',) >Thread-50::DEBUG::2014-06-04 11:06:45,450::task::885::TaskManager.Task::(_run) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::Task._run: 0cc958af-c101-4ae6-8fdc-7cf985a40b17 ('831ef374-8947-47f2-938f-5ec938f4fcef', '32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b') {} failed - stopping task >Thread-50::DEBUG::2014-06-04 11:06:45,450::task::1211::TaskManager.Task::(stop) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::stopping in state preparing (force False) >Thread-50::DEBUG::2014-06-04 11:06:45,450::task::990::TaskManager.Task::(_decref) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::ref 1 aborting True >Thread-50::INFO::2014-06-04 11:06:45,450::task::1168::TaskManager.Task::(prepare) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::aborting: Task is aborted: 'Volume does not exist' - code 201 >Thread-50::DEBUG::2014-06-04 11:06:45,451::task::1173::TaskManager.Task::(prepare) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::Prepare: aborted: Volume does not exist >Thread-50::DEBUG::2014-06-04 11:06:45,451::task::990::TaskManager.Task::(_decref) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::ref 0 aborting True >Thread-50::DEBUG::2014-06-04 11:06:45,451::task::925::TaskManager.Task::(_doAbort) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::Task._doAbort: force False >Thread-50::DEBUG::2014-06-04 11:06:45,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-50::DEBUG::2014-06-04 11:06:45,451::task::595::TaskManager.Task::(_updateState) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::moving from state preparing -> state aborting >Thread-50::DEBUG::2014-06-04 11:06:45,451::task::550::TaskManager.Task::(__state_aborting) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::_aborting: recover policy none >Thread-50::DEBUG::2014-06-04 11:06:45,452::task::595::TaskManager.Task::(_updateState) Task=`0cc958af-c101-4ae6-8fdc-7cf985a40b17`::moving from state aborting -> state failed >Thread-50::DEBUG::2014-06-04 11:06:45,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-50::DEBUG::2014-06-04 11:06:45,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-50::DEBUG::2014-06-04 11:06:45,452::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-50::DEBUG::2014-06-04 11:06:45,452::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-50::DEBUG::2014-06-04 11:06:45,453::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-50::DEBUG::2014-06-04 11:06:45,453::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-50::ERROR::2014-06-04 11:06:45,453::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': "Volume does not exist: ('81fbcbaf-2264-4fa8-831f-da5bf9b5281b',)", 'code': 201}} >Thread-51::DEBUG::2014-06-04 11:06:45,501::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-51::DEBUG::2014-06-04 11:06:45,502::task::595::TaskManager.Task::(_updateState) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::moving from state init -> state preparing >Thread-51::INFO::2014-06-04 11:06:45,502::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', size='1048576', volFormat=5, preallocate=1, diskType=2, volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', desc='hosted-engine.lockspace', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-51::DEBUG::2014-06-04 11:06:45,503::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`672731c5-c3a6-4800-a5d6-578e92b129b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1453' at 'createVolume' >Thread-51::DEBUG::2014-06-04 11:06:45,503::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-51::DEBUG::2014-06-04 11:06:45,503::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-51::DEBUG::2014-06-04 11:06:45,503::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`672731c5-c3a6-4800-a5d6-578e92b129b7`::Granted request >Thread-51::DEBUG::2014-06-04 11:06:45,503::task::827::TaskManager.Task::(resourceAcquired) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-51::DEBUG::2014-06-04 11:06:45,504::task::990::TaskManager.Task::(_decref) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::ref 1 aborting False >Thread-51::DEBUG::2014-06-04 11:06:45,592::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >Thread-51::DEBUG::2014-06-04 11:06:45,733::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-51::INFO::2014-06-04 11:06:45,733::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-51::DEBUG::2014-06-04 11:06:45,733::task::1180::TaskManager.Task::(prepare) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::Prepare: 1 jobs exist, move to acquiring >Thread-51::DEBUG::2014-06-04 11:06:45,733::task::595::TaskManager.Task::(_updateState) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::moving from state preparing -> state acquiring >Thread-51::DEBUG::2014-06-04 11:06:45,734::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >Thread-51::DEBUG::2014-06-04 11:06:45,771::task::595::TaskManager.Task::(_updateState) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::moving from state acquiring -> state queued >Thread-51::DEBUG::2014-06-04 11:06:45,771::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >Thread-51::DEBUG::2014-06-04 11:06:45,822::taskManager::50::TaskManager::(_queueTask) queuing task: c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-51::DEBUG::2014-06-04 11:06:45,822::taskManager::56::TaskManager::(_queueTask) task queued: c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-4::DEBUG::2014-06-04 11:06:45,823::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-51::DEBUG::2014-06-04 11:06:45,824::task::1182::TaskManager.Task::(prepare) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::returning >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,824::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: c62531e8-f925-414c-ab7f-5ab618ca0890 running: <bound method Task.commit of <storage.task.Task instance at 0x7f5f40054488>> with: None >Thread-51::DEBUG::2014-06-04 11:06:45,825::task::990::TaskManager.Task::(_decref) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::ref 0 aborting False >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,825::task::1194::TaskManager.Task::(commit) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::committing task: c62531e8-f925-414c-ab7f-5ab618ca0890 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,826::task::595::TaskManager.Task::(_updateState) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::moving from state queued -> state running >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,828::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,865::task::905::TaskManager.Task::(_runJobs) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x23ef0d0>> (args: ('831ef374-8947-47f2-938f-5ec938f4fcef', '8f3f3871-6aab-4f26-811f-c8e1803414fd', 2048, 5, 1, 2, '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', 'hosted-engine.lockspace', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,865::task::331::TaskManager.Task::(run) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x23ef0d0>> (args: ('831ef374-8947-47f2-938f-5ec938f4fcef', '8f3f3871-6aab-4f26-811f-c8e1803414fd', 2048, 5, 1, 2, '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', 'hosted-engine.lockspace', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,866::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`53805d1a-9d70-4421-918e-9cff197c5599`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1758' at 'createVolume' >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,866::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,866::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,867::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-52::DEBUG::2014-06-04 11:06:45,878::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-52::DEBUG::2014-06-04 11:06:45,878::task::595::TaskManager.Task::(_updateState) Task=`6df0bedf-4a36-41ce-aa93-6c5be1d6fb1b`::moving from state init -> state preparing >Thread-52::INFO::2014-06-04 11:06:45,879::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c62531e8-f925-414c-ab7f-5ab618ca0890', spUUID=None, options=None) >Thread-52::DEBUG::2014-06-04 11:06:45,879::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-52::DEBUG::2014-06-04 11:06:45,879::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'} >Thread-52::INFO::2014-06-04 11:06:45,879::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'}} >Thread-52::DEBUG::2014-06-04 11:06:45,879::task::1185::TaskManager.Task::(prepare) Task=`6df0bedf-4a36-41ce-aa93-6c5be1d6fb1b`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'}} >Thread-52::DEBUG::2014-06-04 11:06:45,880::task::595::TaskManager.Task::(_updateState) Task=`6df0bedf-4a36-41ce-aa93-6c5be1d6fb1b`::moving from state preparing -> state finished >Thread-52::DEBUG::2014-06-04 11:06:45,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-52::DEBUG::2014-06-04 11:06:45,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52::DEBUG::2014-06-04 11:06:45,880::task::990::TaskManager.Task::(_decref) Task=`6df0bedf-4a36-41ce-aa93-6c5be1d6fb1b`::ref 0 aborting False >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,990::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,996::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,996::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,996::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 8f3f3871-6aab-4f26-811f-c8e1803414fd does not exist in domain 831ef374-8947-47f2-938f-5ec938f4fcef >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,996::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' is free. Now locking as 'exclusive' (1 active user) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,997::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`53805d1a-9d70-4421-918e-9cff197c5599`::Granted request >c62531e8-f925-414c-ab7f-5ab618ca0890::INFO::2014-06-04 11:06:45,998::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd for image's volumes >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:45,999::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >c62531e8-f925-414c-ab7f-5ab618ca0890::INFO::2014-06-04 11:06:46,037::volume::443::Storage.Volume::(create) Creating volume 81fbcbaf-2264-4fa8-831f-da5bf9b5281b >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,038::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,081::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,196::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1m --addtag OVIRT_VOL_INITIALIZING --name 81fbcbaf-2264-4fa8-831f-da5bf9b5281b 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,382::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,383::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,383::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,383::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,384::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::WARNING::2014-06-04 11:06:46,384::utils::129::root::(rmFile) File: /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd/81fbcbaf-2264-4fa8-831f-da5bf9b5281b already removed >c62531e8-f925-414c-ab7f-5ab618ca0890::INFO::2014-06-04 11:06:46,385::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd/81fbcbaf-2264-4fa8-831f-da5bf9b5281b with size = 2048 sectors >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,385::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,385::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,515::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,521::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,552::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::WARNING::2014-06-04 11:06:46,553::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,553::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG 831ef374-8947-47f2-938f-5ec938f4fcef >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,554::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_8f3f3871-6aab-4f26-811f-c8e1803414fd 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b' (cwd None) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,723::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,724::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,724::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,724::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b' (cwd None) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,851::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,851::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,852::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,852::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,853::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-53::DEBUG::2014-06-04 11:06:46,930::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-53::DEBUG::2014-06-04 11:06:46,931::task::595::TaskManager.Task::(_updateState) Task=`b2f19647-53c8-4196-a11f-b65f0f04721f`::moving from state init -> state preparing >Thread-53::INFO::2014-06-04 11:06:46,931::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c62531e8-f925-414c-ab7f-5ab618ca0890', spUUID=None, options=None) >Thread-53::DEBUG::2014-06-04 11:06:46,931::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-53::DEBUG::2014-06-04 11:06:46,931::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'} >Thread-53::INFO::2014-06-04 11:06:46,931::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'}} >Thread-53::DEBUG::2014-06-04 11:06:46,931::task::1185::TaskManager.Task::(prepare) Task=`b2f19647-53c8-4196-a11f-b65f0f04721f`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'}} >Thread-53::DEBUG::2014-06-04 11:06:46,931::task::595::TaskManager.Task::(_updateState) Task=`b2f19647-53c8-4196-a11f-b65f0f04721f`::moving from state preparing -> state finished >Thread-53::DEBUG::2014-06-04 11:06:46,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53::DEBUG::2014-06-04 11:06:46,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53::DEBUG::2014-06-04 11:06:46,932::task::990::TaskManager.Task::(_decref) Task=`b2f19647-53c8-4196-a11f-b65f0f04721f`::ref 0 aborting False >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,968::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,973::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,974::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >c62531e8-f925-414c-ab7f-5ab618ca0890::INFO::2014-06-04 11:06:46,974::volume::485::Storage.Volume::(create) The requested size for volume 81fbcbaf-2264-4fa8-831f-da5bf9b5281b doesn't match the granularity on domain 831ef374-8947-47f2-938f-5ec938f4fcef, updating the volume size from 2048 to 262144 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:46,975::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >Dummy-45::DEBUG::2014-06-04 11:06:46,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:47,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114571 s, 8.9 MB/s\n'; <rc> = 0 >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,351::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=81fbcbaf-2264-4fa8-831f-da5bf9b5281b sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef, metaId=('831ef374-8947-47f2-938f-5ec938f4fcef', 4) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,443::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,529::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,529::resourceManager::635::ResourceManager::(releaseResource) Released resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' (0 active users) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,529::resourceManager::641::ResourceManager::(releaseResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' is free, finding out if anyone is waiting for it. >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,530::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd', Clearing records. >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,530::task::595::TaskManager.Task::(_updateState) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::moving from state running -> state finished >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,530::task::752::TaskManager.Task::(_save) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/c62531e8-f925-414c-ab7f-5ab618ca0890.temp >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,580::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,580::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,580::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,581::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,581::task::913::TaskManager.Task::(_runJobs) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::Task.run: exit - success: result {'uuid': '81fbcbaf-2264-4fa8-831f-da5bf9b5281b'} >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,581::task::990::TaskManager.Task::(_decref) Task=`c62531e8-f925-414c-ab7f-5ab618ca0890`::ref 0 aborting False >c62531e8-f925-414c-ab7f-5ab618ca0890::DEBUG::2014-06-04 11:06:47,581::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-54::DEBUG::2014-06-04 11:06:47,980::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-54::DEBUG::2014-06-04 11:06:47,981::task::595::TaskManager.Task::(_updateState) Task=`5c275763-c0f8-48e2-ace0-725a2e516cec`::moving from state init -> state preparing >Thread-54::INFO::2014-06-04 11:06:47,981::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='c62531e8-f925-414c-ab7f-5ab618ca0890', spUUID=None, options=None) >Thread-54::DEBUG::2014-06-04 11:06:47,981::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-54::DEBUG::2014-06-04 11:06:47,981::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'} >Thread-54::INFO::2014-06-04 11:06:47,982::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'}} >Thread-54::DEBUG::2014-06-04 11:06:47,982::task::1185::TaskManager.Task::(prepare) Task=`5c275763-c0f8-48e2-ace0-725a2e516cec`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'c62531e8-f925-414c-ab7f-5ab618ca0890'}} >Thread-54::DEBUG::2014-06-04 11:06:47,982::task::595::TaskManager.Task::(_updateState) Task=`5c275763-c0f8-48e2-ace0-725a2e516cec`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-06-04 11:06:47,982::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-06-04 11:06:47,982::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-06-04 11:06:47,982::task::990::TaskManager.Task::(_decref) Task=`5c275763-c0f8-48e2-ace0-725a2e516cec`::ref 0 aborting False >Thread-55::DEBUG::2014-06-04 11:06:48,030::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-55::DEBUG::2014-06-04 11:06:48,030::task::595::TaskManager.Task::(_updateState) Task=`447ebb4e-025c-4588-b3f0-ddad427c5ea7`::moving from state init -> state preparing >Thread-55::INFO::2014-06-04 11:06:48,031::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='c62531e8-f925-414c-ab7f-5ab618ca0890', spUUID=None, options=None) >Thread-55::DEBUG::2014-06-04 11:06:48,031::taskManager::161::TaskManager::(clearTask) Entry. taskID: c62531e8-f925-414c-ab7f-5ab618ca0890 >Thread-55::DEBUG::2014-06-04 11:06:48,031::taskManager::166::TaskManager::(clearTask) Return. >Thread-55::INFO::2014-06-04 11:06:48,032::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-55::DEBUG::2014-06-04 11:06:48,032::task::1185::TaskManager.Task::(prepare) Task=`447ebb4e-025c-4588-b3f0-ddad427c5ea7`::finished: None >Thread-55::DEBUG::2014-06-04 11:06:48,032::task::595::TaskManager.Task::(_updateState) Task=`447ebb4e-025c-4588-b3f0-ddad427c5ea7`::moving from state preparing -> state finished >Thread-55::DEBUG::2014-06-04 11:06:48,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55::DEBUG::2014-06-04 11:06:48,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55::DEBUG::2014-06-04 11:06:48,032::task::990::TaskManager.Task::(_decref) Task=`447ebb4e-025c-4588-b3f0-ddad427c5ea7`::ref 0 aborting False >Thread-56::DEBUG::2014-06-04 11:06:48,080::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-56::DEBUG::2014-06-04 11:06:48,081::task::595::TaskManager.Task::(_updateState) Task=`a4317dd1-20c5-434b-91e3-f32893b17bf3`::moving from state init -> state preparing >Thread-56::INFO::2014-06-04 11:06:48,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', options=None) >Thread-56::DEBUG::2014-06-04 11:06:48,081::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`28f446c6-3d01-43d4-aa8d-641c885e83e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3106' at 'getVolumePath' >Thread-56::DEBUG::2014-06-04 11:06:48,081::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-56::DEBUG::2014-06-04 11:06:48,081::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-56::DEBUG::2014-06-04 11:06:48,082::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`28f446c6-3d01-43d4-aa8d-641c885e83e1`::Granted request >Thread-56::DEBUG::2014-06-04 11:06:48,082::task::827::TaskManager.Task::(resourceAcquired) Task=`a4317dd1-20c5-434b-91e3-f32893b17bf3`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-56::DEBUG::2014-06-04 11:06:48,082::task::990::TaskManager.Task::(_decref) Task=`a4317dd1-20c5-434b-91e3-f32893b17bf3`::ref 1 aborting False >Thread-56::INFO::2014-06-04 11:06:48,082::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd/81fbcbaf-2264-4fa8-831f-da5bf9b5281b'} >Thread-56::DEBUG::2014-06-04 11:06:48,082::task::1185::TaskManager.Task::(prepare) Task=`a4317dd1-20c5-434b-91e3-f32893b17bf3`::finished: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd/81fbcbaf-2264-4fa8-831f-da5bf9b5281b'} >Thread-56::DEBUG::2014-06-04 11:06:48,083::task::595::TaskManager.Task::(_updateState) Task=`a4317dd1-20c5-434b-91e3-f32893b17bf3`::moving from state preparing -> state finished >Thread-56::DEBUG::2014-06-04 11:06:48,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-56::DEBUG::2014-06-04 11:06:48,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56::DEBUG::2014-06-04 11:06:48,083::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-56::DEBUG::2014-06-04 11:06:48,083::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-56::DEBUG::2014-06-04 11:06:48,083::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-56::DEBUG::2014-06-04 11:06:48,083::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-56::DEBUG::2014-06-04 11:06:48,084::task::990::TaskManager.Task::(_decref) Task=`a4317dd1-20c5-434b-91e3-f32893b17bf3`::ref 0 aborting False >Thread-57::DEBUG::2014-06-04 11:06:48,131::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-57::DEBUG::2014-06-04 11:06:48,131::task::595::TaskManager.Task::(_updateState) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::moving from state init -> state preparing >Thread-57::INFO::2014-06-04 11:06:48,132::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='577e8169-cbb0-401a-8aff-c6fdeaf4697f', volUUID='df5b7676-a495-4383-bae9-acc1ae2dc830', options=None) >Thread-57::DEBUG::2014-06-04 11:06:48,132::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`db226864-7fc6-44c9-9ec9-cb940dbfe2b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3106' at 'getVolumePath' >Thread-57::DEBUG::2014-06-04 11:06:48,132::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-57::DEBUG::2014-06-04 11:06:48,132::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-57::DEBUG::2014-06-04 11:06:48,132::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`db226864-7fc6-44c9-9ec9-cb940dbfe2b7`::Granted request >Thread-57::DEBUG::2014-06-04 11:06:48,133::task::827::TaskManager.Task::(resourceAcquired) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-57::DEBUG::2014-06-04 11:06:48,133::task::990::TaskManager.Task::(_decref) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::ref 1 aborting False >Thread-57::DEBUG::2014-06-04 11:06:48,133::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-57::DEBUG::2014-06-04 11:06:48,134::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-57::DEBUG::2014-06-04 11:06:48,244::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-57::DEBUG::2014-06-04 11:06:48,250::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-57::DEBUG::2014-06-04 11:06:48,250::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-57::WARNING::2014-06-04 11:06:48,250::lvm::607::Storage.LVM::(getLv) lv: df5b7676-a495-4383-bae9-acc1ae2dc830 not found in lvs vg: 831ef374-8947-47f2-938f-5ec938f4fcef response >Thread-57::ERROR::2014-06-04 11:06:48,250::task::866::TaskManager.Task::(_setError) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3109, in getVolumePath > volUUID=volUUID).getVolumePath() > File "/usr/share/vdsm/storage/sd.py", line 389, in produceVolume > volUUID) > File "/usr/share/vdsm/storage/blockVolume.py", line 80, in __init__ > volume.Volume.__init__(self, repoPath, sdUUID, imgUUID, volUUID) > File "/usr/share/vdsm/storage/volume.py", line 140, in __init__ > self.validate() > File "/usr/share/vdsm/storage/blockVolume.py", line 88, in validate > raise se.VolumeDoesNotExist(self.volUUID) # Fix me >VolumeDoesNotExist: Volume does not exist: ('df5b7676-a495-4383-bae9-acc1ae2dc830',) >Thread-57::DEBUG::2014-06-04 11:06:48,251::task::885::TaskManager.Task::(_run) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::Task._run: d18225bb-bc06-47db-b0d7-95802d0ee968 ('831ef374-8947-47f2-938f-5ec938f4fcef', '32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '577e8169-cbb0-401a-8aff-c6fdeaf4697f', 'df5b7676-a495-4383-bae9-acc1ae2dc830') {} failed - stopping task >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::1211::TaskManager.Task::(stop) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::stopping in state preparing (force False) >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::990::TaskManager.Task::(_decref) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::ref 1 aborting True >Thread-57::INFO::2014-06-04 11:06:48,252::task::1168::TaskManager.Task::(prepare) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::aborting: Task is aborted: 'Volume does not exist' - code 201 >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::1173::TaskManager.Task::(prepare) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::Prepare: aborted: Volume does not exist >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::990::TaskManager.Task::(_decref) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::ref 0 aborting True >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::925::TaskManager.Task::(_doAbort) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::Task._doAbort: force False >Thread-57::DEBUG::2014-06-04 11:06:48,252::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::595::TaskManager.Task::(_updateState) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::moving from state preparing -> state aborting >Thread-57::DEBUG::2014-06-04 11:06:48,252::task::550::TaskManager.Task::(__state_aborting) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::_aborting: recover policy none >Thread-57::DEBUG::2014-06-04 11:06:48,253::task::595::TaskManager.Task::(_updateState) Task=`d18225bb-bc06-47db-b0d7-95802d0ee968`::moving from state aborting -> state failed >Thread-57::DEBUG::2014-06-04 11:06:48,253::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-57::DEBUG::2014-06-04 11:06:48,253::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-06-04 11:06:48,253::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-57::DEBUG::2014-06-04 11:06:48,261::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-57::DEBUG::2014-06-04 11:06:48,261::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-57::DEBUG::2014-06-04 11:06:48,261::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-57::ERROR::2014-06-04 11:06:48,262::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': "Volume does not exist: ('df5b7676-a495-4383-bae9-acc1ae2dc830',)", 'code': 201}} >Thread-58::DEBUG::2014-06-04 11:06:48,311::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-58::DEBUG::2014-06-04 11:06:48,311::task::595::TaskManager.Task::(_updateState) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::moving from state init -> state preparing >Thread-58::INFO::2014-06-04 11:06:48,311::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='577e8169-cbb0-401a-8aff-c6fdeaf4697f', size='1028096', volFormat=5, preallocate=1, diskType=2, volUUID='df5b7676-a495-4383-bae9-acc1ae2dc830', desc='hosted-engine.metadata', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-58::DEBUG::2014-06-04 11:06:48,312::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`24f0ad6c-2998-49ce-9d94-0d7311387a0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1453' at 'createVolume' >Thread-58::DEBUG::2014-06-04 11:06:48,312::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-58::DEBUG::2014-06-04 11:06:48,312::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-58::DEBUG::2014-06-04 11:06:48,312::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`24f0ad6c-2998-49ce-9d94-0d7311387a0f`::Granted request >Thread-58::DEBUG::2014-06-04 11:06:48,313::task::827::TaskManager.Task::(resourceAcquired) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-58::DEBUG::2014-06-04 11:06:48,313::task::990::TaskManager.Task::(_decref) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::ref 1 aborting False >Thread-58::DEBUG::2014-06-04 11:06:48,314::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >Thread-58::DEBUG::2014-06-04 11:06:48,335::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-58::INFO::2014-06-04 11:06:48,336::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-58::DEBUG::2014-06-04 11:06:48,336::task::1180::TaskManager.Task::(prepare) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::Prepare: 1 jobs exist, move to acquiring >Thread-58::DEBUG::2014-06-04 11:06:48,336::task::595::TaskManager.Task::(_updateState) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::moving from state preparing -> state acquiring >Thread-58::DEBUG::2014-06-04 11:06:48,336::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >Thread-58::DEBUG::2014-06-04 11:06:48,378::task::595::TaskManager.Task::(_updateState) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::moving from state acquiring -> state queued >Thread-58::DEBUG::2014-06-04 11:06:48,379::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >Thread-58::DEBUG::2014-06-04 11:06:48,421::taskManager::50::TaskManager::(_queueTask) queuing task: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-58::DEBUG::2014-06-04 11:06:48,421::taskManager::56::TaskManager::(_queueTask) task queued: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-3::DEBUG::2014-06-04 11:06:48,421::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-58::DEBUG::2014-06-04 11:06:48,422::task::1182::TaskManager.Task::(prepare) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::returning >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,422::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: f1f3b430-958e-473a-b3e4-4c89e6db46a1 running: <bound method Task.commit of <storage.task.Task instance at 0x7f5f4007c368>> with: None >Thread-58::DEBUG::2014-06-04 11:06:48,423::task::990::TaskManager.Task::(_decref) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::ref 0 aborting False >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,423::task::1194::TaskManager.Task::(commit) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::committing task: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,425::task::595::TaskManager.Task::(_updateState) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::moving from state queued -> state running >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,427::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,464::task::905::TaskManager.Task::(_runJobs) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x23ef0d0>> (args: ('831ef374-8947-47f2-938f-5ec938f4fcef', '577e8169-cbb0-401a-8aff-c6fdeaf4697f', 2008, 5, 1, 2, 'df5b7676-a495-4383-bae9-acc1ae2dc830', 'hosted-engine.metadata', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,464::task::331::TaskManager.Task::(run) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x23ef0d0>> (args: ('831ef374-8947-47f2-938f-5ec938f4fcef', '577e8169-cbb0-401a-8aff-c6fdeaf4697f', 2008, 5, 1, 2, 'df5b7676-a495-4383-bae9-acc1ae2dc830', 'hosted-engine.metadata', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,464::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f`ReqID=`fd547cff-40f6-46ee-a82c-384cf4d78bdf`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1758' at 'createVolume' >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,464::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' for lock type 'exclusive' >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,465::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,466::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-59::DEBUG::2014-06-04 11:06:48,473::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-59::DEBUG::2014-06-04 11:06:48,474::task::595::TaskManager.Task::(_updateState) Task=`235aed3b-178b-4a27-a83b-4ca5c4fef02c`::moving from state init -> state preparing >Thread-59::INFO::2014-06-04 11:06:48,474::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='f1f3b430-958e-473a-b3e4-4c89e6db46a1', spUUID=None, options=None) >Thread-59::DEBUG::2014-06-04 11:06:48,474::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-59::DEBUG::2014-06-04 11:06:48,475::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'} >Thread-59::INFO::2014-06-04 11:06:48,475::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'}} >Thread-59::DEBUG::2014-06-04 11:06:48,475::task::1185::TaskManager.Task::(prepare) Task=`235aed3b-178b-4a27-a83b-4ca5c4fef02c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'}} >Thread-59::DEBUG::2014-06-04 11:06:48,475::task::595::TaskManager.Task::(_updateState) Task=`235aed3b-178b-4a27-a83b-4ca5c4fef02c`::moving from state preparing -> state finished >Thread-59::DEBUG::2014-06-04 11:06:48,475::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-59::DEBUG::2014-06-04 11:06:48,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-59::DEBUG::2014-06-04 11:06:48,475::task::990::TaskManager.Task::(_decref) Task=`235aed3b-178b-4a27-a83b-4ca5c4fef02c`::ref 0 aborting False >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,579::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,585::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,585::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,585::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 577e8169-cbb0-401a-8aff-c6fdeaf4697f does not exist in domain 831ef374-8947-47f2-938f-5ec938f4fcef >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,585::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' is free. Now locking as 'exclusive' (1 active user) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,585::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f`ReqID=`fd547cff-40f6-46ee-a82c-384cf4d78bdf`::Granted request >f1f3b430-958e-473a-b3e4-4c89e6db46a1::INFO::2014-06-04 11:06:48,586::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f for image's volumes >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,587::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::INFO::2014-06-04 11:06:48,611::volume::443::Storage.Volume::(create) Creating volume df5b7676-a495-4383-bae9-acc1ae2dc830 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,611::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,645::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,678::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1m --addtag OVIRT_VOL_INITIALIZING --name df5b7676-a495-4383-bae9-acc1ae2dc830 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,841::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,841::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,842::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,842::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,842::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::WARNING::2014-06-04 11:06:48,842::utils::129::root::(rmFile) File: /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f/df5b7676-a495-4383-bae9-acc1ae2dc830 already removed >f1f3b430-958e-473a-b3e4-4c89e6db46a1::INFO::2014-06-04 11:06:48,843::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f/df5b7676-a495-4383-bae9-acc1ae2dc830 with size = 2008 sectors >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,843::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,844::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,958::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,964::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,964::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::WARNING::2014-06-04 11:06:48,964::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,964::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 5 in VG 831ef374-8947-47f2-938f-5ec938f4fcef >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:48,965::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag PU_00000000-0000-0000-0000-000000000000 --addtag MD_5 --addtag IU_577e8169-cbb0-401a-8aff-c6fdeaf4697f 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830' (cwd None) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,138::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,139::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,139::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,139::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:49,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:49,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.107086 s, 9.6 MB/s\n'; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,299::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,299::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,299::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,300::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,300::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,415::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,422::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,422::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >f1f3b430-958e-473a-b3e4-4c89e6db46a1::INFO::2014-06-04 11:06:49,423::volume::485::Storage.Volume::(create) The requested size for volume df5b7676-a495-4383-bae9-acc1ae2dc830 doesn't match the granularity on domain 831ef374-8947-47f2-938f-5ec938f4fcef, updating the volume size from 2008 to 262144 >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,423::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,467::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=df5b7676-a495-4383-bae9-acc1ae2dc830 sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef, metaId=('831ef374-8947-47f2-938f-5ec938f4fcef', 5) >Thread-60::DEBUG::2014-06-04 11:06:49,525::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-60::DEBUG::2014-06-04 11:06:49,526::task::595::TaskManager.Task::(_updateState) Task=`8137729b-61dd-4c57-95c8-1d562a9025d1`::moving from state init -> state preparing >Thread-60::INFO::2014-06-04 11:06:49,526::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='f1f3b430-958e-473a-b3e4-4c89e6db46a1', spUUID=None, options=None) >Thread-60::DEBUG::2014-06-04 11:06:49,526::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-60::DEBUG::2014-06-04 11:06:49,526::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'} >Thread-60::INFO::2014-06-04 11:06:49,526::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'}} >Thread-60::DEBUG::2014-06-04 11:06:49,527::task::1185::TaskManager.Task::(prepare) Task=`8137729b-61dd-4c57-95c8-1d562a9025d1`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'}} >Thread-60::DEBUG::2014-06-04 11:06:49,527::task::595::TaskManager.Task::(_updateState) Task=`8137729b-61dd-4c57-95c8-1d562a9025d1`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-06-04 11:06:49,527::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-06-04 11:06:49,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-06-04 11:06:49,527::task::990::TaskManager.Task::(_decref) Task=`8137729b-61dd-4c57-95c8-1d562a9025d1`::ref 0 aborting False >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,562::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,701::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,701::resourceManager::635::ResourceManager::(releaseResource) Released resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' (0 active users) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,701::resourceManager::641::ResourceManager::(releaseResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' is free, finding out if anyone is waiting for it. >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,701::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f', Clearing records. >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,702::task::595::TaskManager.Task::(_updateState) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::moving from state running -> state finished >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,702::task::752::TaskManager.Task::(_save) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/f1f3b430-958e-473a-b3e4-4c89e6db46a1.temp >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,736::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,736::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,736::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,736::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,736::task::913::TaskManager.Task::(_runJobs) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::Task.run: exit - success: result {'uuid': 'df5b7676-a495-4383-bae9-acc1ae2dc830'} >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,737::task::990::TaskManager.Task::(_decref) Task=`f1f3b430-958e-473a-b3e4-4c89e6db46a1`::ref 0 aborting False >f1f3b430-958e-473a-b3e4-4c89e6db46a1::DEBUG::2014-06-04 11:06:49,737::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-61::DEBUG::2014-06-04 11:06:50,577::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-61::DEBUG::2014-06-04 11:06:50,578::task::595::TaskManager.Task::(_updateState) Task=`cc504f1e-9017-47d6-bc84-fb54a5b17297`::moving from state init -> state preparing >Thread-61::INFO::2014-06-04 11:06:50,578::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='f1f3b430-958e-473a-b3e4-4c89e6db46a1', spUUID=None, options=None) >Thread-61::DEBUG::2014-06-04 11:06:50,578::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-61::DEBUG::2014-06-04 11:06:50,578::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'} >Thread-61::INFO::2014-06-04 11:06:50,578::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'}} >Thread-61::DEBUG::2014-06-04 11:06:50,578::task::1185::TaskManager.Task::(prepare) Task=`cc504f1e-9017-47d6-bc84-fb54a5b17297`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'f1f3b430-958e-473a-b3e4-4c89e6db46a1'}} >Thread-61::DEBUG::2014-06-04 11:06:50,579::task::595::TaskManager.Task::(_updateState) Task=`cc504f1e-9017-47d6-bc84-fb54a5b17297`::moving from state preparing -> state finished >Thread-61::DEBUG::2014-06-04 11:06:50,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2014-06-04 11:06:50,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2014-06-04 11:06:50,579::task::990::TaskManager.Task::(_decref) Task=`cc504f1e-9017-47d6-bc84-fb54a5b17297`::ref 0 aborting False >Thread-62::DEBUG::2014-06-04 11:06:50,627::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-62::DEBUG::2014-06-04 11:06:50,627::task::595::TaskManager.Task::(_updateState) Task=`223844fd-6a9c-48e6-a8d8-f1288a8a414a`::moving from state init -> state preparing >Thread-62::INFO::2014-06-04 11:06:50,628::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='f1f3b430-958e-473a-b3e4-4c89e6db46a1', spUUID=None, options=None) >Thread-62::DEBUG::2014-06-04 11:06:50,628::taskManager::161::TaskManager::(clearTask) Entry. taskID: f1f3b430-958e-473a-b3e4-4c89e6db46a1 >Thread-62::DEBUG::2014-06-04 11:06:50,628::taskManager::166::TaskManager::(clearTask) Return. >Thread-62::INFO::2014-06-04 11:06:50,629::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-62::DEBUG::2014-06-04 11:06:50,629::task::1185::TaskManager.Task::(prepare) Task=`223844fd-6a9c-48e6-a8d8-f1288a8a414a`::finished: None >Thread-62::DEBUG::2014-06-04 11:06:50,629::task::595::TaskManager.Task::(_updateState) Task=`223844fd-6a9c-48e6-a8d8-f1288a8a414a`::moving from state preparing -> state finished >Thread-62::DEBUG::2014-06-04 11:06:50,629::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-62::DEBUG::2014-06-04 11:06:50,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2014-06-04 11:06:50,629::task::990::TaskManager.Task::(_decref) Task=`223844fd-6a9c-48e6-a8d8-f1288a8a414a`::ref 0 aborting False >Thread-63::DEBUG::2014-06-04 11:06:50,677::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-63::DEBUG::2014-06-04 11:06:50,678::task::595::TaskManager.Task::(_updateState) Task=`64621e91-595d-4a8d-a311-84a29b12fb18`::moving from state init -> state preparing >Thread-63::INFO::2014-06-04 11:06:50,678::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='577e8169-cbb0-401a-8aff-c6fdeaf4697f', volUUID='df5b7676-a495-4383-bae9-acc1ae2dc830', options=None) >Thread-63::DEBUG::2014-06-04 11:06:50,678::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`b0bdc9b2-5cd0-4e1f-969b-68c1624f8892`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3106' at 'getVolumePath' >Thread-63::DEBUG::2014-06-04 11:06:50,678::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-63::DEBUG::2014-06-04 11:06:50,678::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-63::DEBUG::2014-06-04 11:06:50,679::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`b0bdc9b2-5cd0-4e1f-969b-68c1624f8892`::Granted request >Thread-63::DEBUG::2014-06-04 11:06:50,679::task::827::TaskManager.Task::(resourceAcquired) Task=`64621e91-595d-4a8d-a311-84a29b12fb18`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-63::DEBUG::2014-06-04 11:06:50,679::task::990::TaskManager.Task::(_decref) Task=`64621e91-595d-4a8d-a311-84a29b12fb18`::ref 1 aborting False >Thread-63::INFO::2014-06-04 11:06:50,679::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f/df5b7676-a495-4383-bae9-acc1ae2dc830'} >Thread-63::DEBUG::2014-06-04 11:06:50,679::task::1185::TaskManager.Task::(prepare) Task=`64621e91-595d-4a8d-a311-84a29b12fb18`::finished: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f/df5b7676-a495-4383-bae9-acc1ae2dc830'} >Thread-63::DEBUG::2014-06-04 11:06:50,680::task::595::TaskManager.Task::(_updateState) Task=`64621e91-595d-4a8d-a311-84a29b12fb18`::moving from state preparing -> state finished >Thread-63::DEBUG::2014-06-04 11:06:50,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-63::DEBUG::2014-06-04 11:06:50,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-63::DEBUG::2014-06-04 11:06:50,680::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-63::DEBUG::2014-06-04 11:06:50,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-63::DEBUG::2014-06-04 11:06:50,680::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-63::DEBUG::2014-06-04 11:06:50,680::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-63::DEBUG::2014-06-04 11:06:50,681::task::990::TaskManager.Task::(_decref) Task=`64621e91-595d-4a8d-a311-84a29b12fb18`::ref 0 aborting False >Thread-64::DEBUG::2014-06-04 11:06:50,728::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-64::DEBUG::2014-06-04 11:06:50,729::task::595::TaskManager.Task::(_updateState) Task=`daa05060-07a1-45ac-8732-9870d2f63b01`::moving from state init -> state preparing >Thread-64::INFO::2014-06-04 11:06:50,729::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-64::DEBUG::2014-06-04 11:06:50,729::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`2c81eb6d-1fd1-48d5-85e0-72abb363e6d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-64::DEBUG::2014-06-04 11:06:50,729::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-64::DEBUG::2014-06-04 11:06:50,729::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-64::DEBUG::2014-06-04 11:06:50,730::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`2c81eb6d-1fd1-48d5-85e0-72abb363e6d6`::Granted request >Thread-64::DEBUG::2014-06-04 11:06:50,730::task::827::TaskManager.Task::(resourceAcquired) Task=`daa05060-07a1-45ac-8732-9870d2f63b01`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-64::DEBUG::2014-06-04 11:06:50,730::task::990::TaskManager.Task::(_decref) Task=`daa05060-07a1-45ac-8732-9870d2f63b01`::ref 1 aborting False >Thread-64::DEBUG::2014-06-04 11:06:50,730::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`22397f7b-44c3-4297-8fd4-640304f9215b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-64::DEBUG::2014-06-04 11:06:50,730::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-64::DEBUG::2014-06-04 11:06:50,731::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:50,731::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:50,842::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:50,850::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-64::DEBUG::2014-06-04 11:06:50,850::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:50,853::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:50,858::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000570308 s, 898 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:50,859::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000570308 s, 898 kB/s'], size: 512 >Thread-64::DEBUG::2014-06-04 11:06:50,862::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:50,868::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000606543 s, 844 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:50,868::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000606543 s, 844 kB/s'], size: 512 >Thread-64::INFO::2014-06-04 11:06:50,869::image::215::Storage.Image::(getChain) sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef imgUUID=8f3f3871-6aab-4f26-811f-c8e1803414fd chain=[<storage.blockVolume.BlockVolume object at 0x7f5f7801a510>] >Thread-64::DEBUG::2014-06-04 11:06:50,869::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b`ReqID=`3605454e-c1cc-42b4-8e1a-fd559efec8c8`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-64::DEBUG::2014-06-04 11:06:50,869::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b' for lock type 'exclusive' >Thread-64::DEBUG::2014-06-04 11:06:50,870::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b' is free. Now locking as 'exclusive' (1 active user) >Thread-64::DEBUG::2014-06-04 11:06:50,870::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b`ReqID=`3605454e-c1cc-42b4-8e1a-fd559efec8c8`::Granted request >Thread-64::DEBUG::2014-06-04 11:06:50,870::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' is free. Now locking as 'exclusive' (1 active user) >Thread-64::DEBUG::2014-06-04 11:06:50,870::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`22397f7b-44c3-4297-8fd4-640304f9215b`::Granted request >Thread-64::DEBUG::2014-06-04 11:06:50,871::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:50,987::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:50,988::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:50,988::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::INFO::2014-06-04 11:06:50,988::volume::789::Storage.Volume::(prepare) Volume: preparing volume 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b >Thread-64::DEBUG::2014-06-04 11:06:50,989::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:50,989::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:51,097::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,104::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-64::DEBUG::2014-06-04 11:06:51,105::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:51,108::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:51,113::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.00058099 s, 881 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,114::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.00058099 s, 881 kB/s'], size: 512 >Thread-64::DEBUG::2014-06-04 11:06:51,117::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:51,123::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000602728 s, 849 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,123::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000602728 s, 849 kB/s'], size: 512 >Thread-64::DEBUG::2014-06-04 11:06:51,124::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b`ReqID=`81ee6893-1092-4343-90fa-db9c80efd34b`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >Thread-64::DEBUG::2014-06-04 11:06:51,124::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b' for lock type 'exclusive' >Thread-64::DEBUG::2014-06-04 11:06:51,125::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:51,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:51,416::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,418::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:51,419::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:51,420::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b' is free. Now locking as 'exclusive' (1 active user) >Thread-64::DEBUG::2014-06-04 11:06:51,421::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.81fbcbaf-2264-4fa8-831f-da5bf9b5281b`ReqID=`81ee6893-1092-4343-90fa-db9c80efd34b`::Granted request >Thread-64::DEBUG::2014-06-04 11:06:51,424::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:51,428::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:51,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.112088 s, 9.1 MB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,545::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,552::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-64::DEBUG::2014-06-04 11:06:51,552::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-64::DEBUG::2014-06-04 11:06:51,555::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:51,562::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000564814 s, 906 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,562::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000564814 s, 906 kB/s'], size: 512 >Thread-64::DEBUG::2014-06-04 11:06:51,565::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-64::DEBUG::2014-06-04 11:06:51,571::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000600082 s, 853 kB/s\n'; <rc> = 0 >Thread-64::DEBUG::2014-06-04 11:06:51,571::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000600082 s, 853 kB/s'], size: 512 >Thread-64::INFO::2014-06-04 11:06:51,575::logUtils::47::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None >Thread-64::DEBUG::2014-06-04 11:06:51,576::task::1185::TaskManager.Task::(prepare) Task=`daa05060-07a1-45ac-8732-9870d2f63b01`::finished: None >Thread-64::DEBUG::2014-06-04 11:06:51,576::task::595::TaskManager.Task::(_updateState) Task=`daa05060-07a1-45ac-8732-9870d2f63b01`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-06-04 11:06:51,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-64::DEBUG::2014-06-04 11:06:51,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-06-04 11:06:51,576::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-64::DEBUG::2014-06-04 11:06:51,577::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-64::DEBUG::2014-06-04 11:06:51,577::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-64::DEBUG::2014-06-04 11:06:51,577::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-64::DEBUG::2014-06-04 11:06:51,577::task::990::TaskManager.Task::(_decref) Task=`daa05060-07a1-45ac-8732-9870d2f63b01`::ref 0 aborting False >Thread-65::DEBUG::2014-06-04 11:06:51,625::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-65::DEBUG::2014-06-04 11:06:51,626::task::595::TaskManager.Task::(_updateState) Task=`f3d07142-5a43-4ecc-9b88-81c20b91e6be`::moving from state init -> state preparing >Thread-65::INFO::2014-06-04 11:06:51,626::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', options=None) >Thread-65::DEBUG::2014-06-04 11:06:51,626::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`82eca71a-0a3d-459b-a1ad-626069ee5a4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3106' at 'getVolumePath' >Thread-65::DEBUG::2014-06-04 11:06:51,627::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-65::DEBUG::2014-06-04 11:06:51,627::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-65::DEBUG::2014-06-04 11:06:51,627::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`82eca71a-0a3d-459b-a1ad-626069ee5a4a`::Granted request >Thread-65::DEBUG::2014-06-04 11:06:51,627::task::827::TaskManager.Task::(resourceAcquired) Task=`f3d07142-5a43-4ecc-9b88-81c20b91e6be`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-65::DEBUG::2014-06-04 11:06:51,627::task::990::TaskManager.Task::(_decref) Task=`f3d07142-5a43-4ecc-9b88-81c20b91e6be`::ref 1 aborting False >Thread-65::INFO::2014-06-04 11:06:51,628::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd/81fbcbaf-2264-4fa8-831f-da5bf9b5281b'} >Thread-65::DEBUG::2014-06-04 11:06:51,628::task::1185::TaskManager.Task::(prepare) Task=`f3d07142-5a43-4ecc-9b88-81c20b91e6be`::finished: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd/81fbcbaf-2264-4fa8-831f-da5bf9b5281b'} >Thread-65::DEBUG::2014-06-04 11:06:51,628::task::595::TaskManager.Task::(_updateState) Task=`f3d07142-5a43-4ecc-9b88-81c20b91e6be`::moving from state preparing -> state finished >Thread-65::DEBUG::2014-06-04 11:06:51,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-65::DEBUG::2014-06-04 11:06:51,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-65::DEBUG::2014-06-04 11:06:51,628::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-65::DEBUG::2014-06-04 11:06:51,628::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-65::DEBUG::2014-06-04 11:06:51,629::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-65::DEBUG::2014-06-04 11:06:51,629::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-65::DEBUG::2014-06-04 11:06:51,629::task::990::TaskManager.Task::(_decref) Task=`f3d07142-5a43-4ecc-9b88-81c20b91e6be`::ref 0 aborting False >Thread-66::DEBUG::2014-06-04 11:06:51,676::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-66::DEBUG::2014-06-04 11:06:51,677::task::595::TaskManager.Task::(_updateState) Task=`61318719-bc0a-4716-8378-b0a2fd6b8f9c`::moving from state init -> state preparing >Thread-66::INFO::2014-06-04 11:06:51,677::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='577e8169-cbb0-401a-8aff-c6fdeaf4697f', volUUID='df5b7676-a495-4383-bae9-acc1ae2dc830', rw=True, options=None) >Thread-66::DEBUG::2014-06-04 11:06:51,677::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`60ef4086-38c3-46c5-b607-9f5388fd8987`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-66::DEBUG::2014-06-04 11:06:51,677::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-66::DEBUG::2014-06-04 11:06:51,678::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-66::DEBUG::2014-06-04 11:06:51,678::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`60ef4086-38c3-46c5-b607-9f5388fd8987`::Granted request >Thread-66::DEBUG::2014-06-04 11:06:51,678::task::827::TaskManager.Task::(resourceAcquired) Task=`61318719-bc0a-4716-8378-b0a2fd6b8f9c`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-66::DEBUG::2014-06-04 11:06:51,678::task::990::TaskManager.Task::(_decref) Task=`61318719-bc0a-4716-8378-b0a2fd6b8f9c`::ref 1 aborting False >Thread-66::DEBUG::2014-06-04 11:06:51,679::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f`ReqID=`fcf5d6aa-1345-479c-96a6-8dec25e3f7a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-66::DEBUG::2014-06-04 11:06:51,679::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' for lock type 'exclusive' >Thread-66::DEBUG::2014-06-04 11:06:51,679::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:51,680::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:51,790::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:51,798::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-66::DEBUG::2014-06-04 11:06:51,804::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:51,806::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:51,812::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000573802 s, 892 kB/s\n'; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:51,813::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000573802 s, 892 kB/s'], size: 512 >Thread-66::DEBUG::2014-06-04 11:06:51,816::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:51,822::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000601533 s, 851 kB/s\n'; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:51,822::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000601533 s, 851 kB/s'], size: 512 >Thread-66::INFO::2014-06-04 11:06:51,822::image::215::Storage.Image::(getChain) sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef imgUUID=577e8169-cbb0-401a-8aff-c6fdeaf4697f chain=[<storage.blockVolume.BlockVolume object at 0x7f5f78034990>] >Thread-66::DEBUG::2014-06-04 11:06:51,823::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.df5b7676-a495-4383-bae9-acc1ae2dc830`ReqID=`4584d0e9-f5f9-49c0-8c0f-fa4cf0babadf`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-66::DEBUG::2014-06-04 11:06:51,823::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.df5b7676-a495-4383-bae9-acc1ae2dc830' for lock type 'exclusive' >Thread-66::DEBUG::2014-06-04 11:06:51,823::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.df5b7676-a495-4383-bae9-acc1ae2dc830' is free. Now locking as 'exclusive' (1 active user) >Thread-66::DEBUG::2014-06-04 11:06:51,824::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS.df5b7676-a495-4383-bae9-acc1ae2dc830`ReqID=`4584d0e9-f5f9-49c0-8c0f-fa4cf0babadf`::Granted request >Thread-66::DEBUG::2014-06-04 11:06:51,824::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f' is free. Now locking as 'exclusive' (1 active user) >Thread-66::DEBUG::2014-06-04 11:06:51,824::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.577e8169-cbb0-401a-8aff-c6fdeaf4697f`ReqID=`fcf5d6aa-1345-479c-96a6-8dec25e3f7a9`::Granted request >Thread-66::DEBUG::2014-06-04 11:06:51,825::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:51,939::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:51,940::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:51,940::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-66::INFO::2014-06-04 11:06:51,940::volume::789::Storage.Volume::(prepare) Volume: preparing volume 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830 >Thread-66::DEBUG::2014-06-04 11:06:51,940::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:51,941::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,056::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,064::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-66::DEBUG::2014-06-04 11:06:52,064::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:52,067::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,073::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000600413 s, 853 kB/s\n'; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,073::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000600413 s, 853 kB/s'], size: 512 >Thread-66::DEBUG::2014-06-04 11:06:52,075::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,081::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000578659 s, 885 kB/s\n'; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,081::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000578659 s, 885 kB/s'], size: 512 >Thread-66::DEBUG::2014-06-04 11:06:52,082::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.df5b7676-a495-4383-bae9-acc1ae2dc830`ReqID=`6fdd4adb-31d2-48cc-8b2d-a8bbe9b8b5e9`::Request was made in '/usr/share/vdsm/storage/volume.py' line '806' at 'prepare' >Thread-66::DEBUG::2014-06-04 11:06:52,082::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.df5b7676-a495-4383-bae9-acc1ae2dc830' for lock type 'exclusive' >Thread-66::DEBUG::2014-06-04 11:06:52,083::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,280::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,280::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:52,280::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:52,281::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.df5b7676-a495-4383-bae9-acc1ae2dc830' is free. Now locking as 'exclusive' (1 active user) >Thread-66::DEBUG::2014-06-04 11:06:52,281::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS.df5b7676-a495-4383-bae9-acc1ae2dc830`ReqID=`6fdd4adb-31d2-48cc-8b2d-a8bbe9b8b5e9`::Granted request >Thread-66::DEBUG::2014-06-04 11:06:52,282::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:52,282::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,397::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,404::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-66::DEBUG::2014-06-04 11:06:52,414::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-66::DEBUG::2014-06-04 11:06:52,417::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,423::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000605349 s, 846 kB/s\n'; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,424::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000605349 s, 846 kB/s'], size: 512 >Thread-66::DEBUG::2014-06-04 11:06:52,427::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=5 bs=512 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-66::DEBUG::2014-06-04 11:06:52,433::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000596735 s, 858 kB/s\n'; <rc> = 0 >Thread-66::DEBUG::2014-06-04 11:06:52,433::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000596735 s, 858 kB/s'], size: 512 >Thread-66::INFO::2014-06-04 11:06:52,437::logUtils::47::dispatcher::(wrapper) Run and protect: prepareVolume, Return response: None >Thread-66::DEBUG::2014-06-04 11:06:52,437::task::1185::TaskManager.Task::(prepare) Task=`61318719-bc0a-4716-8378-b0a2fd6b8f9c`::finished: None >Thread-66::DEBUG::2014-06-04 11:06:52,437::task::595::TaskManager.Task::(_updateState) Task=`61318719-bc0a-4716-8378-b0a2fd6b8f9c`::moving from state preparing -> state finished >Thread-66::DEBUG::2014-06-04 11:06:52,437::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-66::DEBUG::2014-06-04 11:06:52,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-66::DEBUG::2014-06-04 11:06:52,438::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-66::DEBUG::2014-06-04 11:06:52,438::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-66::DEBUG::2014-06-04 11:06:52,438::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-66::DEBUG::2014-06-04 11:06:52,439::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-66::DEBUG::2014-06-04 11:06:52,439::task::990::TaskManager.Task::(_decref) Task=`61318719-bc0a-4716-8378-b0a2fd6b8f9c`::ref 0 aborting False >Thread-67::DEBUG::2014-06-04 11:06:52,487::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-67::DEBUG::2014-06-04 11:06:52,488::task::595::TaskManager.Task::(_updateState) Task=`80d777ad-b5bf-476e-9c95-6c8d2a247174`::moving from state init -> state preparing >Thread-67::INFO::2014-06-04 11:06:52,488::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='577e8169-cbb0-401a-8aff-c6fdeaf4697f', volUUID='df5b7676-a495-4383-bae9-acc1ae2dc830', options=None) >Thread-67::DEBUG::2014-06-04 11:06:52,488::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`b7683abe-c265-4295-a479-36fb315bee52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3106' at 'getVolumePath' >Thread-67::DEBUG::2014-06-04 11:06:52,489::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-67::DEBUG::2014-06-04 11:06:52,489::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-67::DEBUG::2014-06-04 11:06:52,489::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`b7683abe-c265-4295-a479-36fb315bee52`::Granted request >Thread-67::DEBUG::2014-06-04 11:06:52,490::task::827::TaskManager.Task::(resourceAcquired) Task=`80d777ad-b5bf-476e-9c95-6c8d2a247174`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-67::DEBUG::2014-06-04 11:06:52,490::task::990::TaskManager.Task::(_decref) Task=`80d777ad-b5bf-476e-9c95-6c8d2a247174`::ref 1 aborting False >Thread-67::INFO::2014-06-04 11:06:52,490::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f/df5b7676-a495-4383-bae9-acc1ae2dc830'} >Thread-67::DEBUG::2014-06-04 11:06:52,491::task::1185::TaskManager.Task::(prepare) Task=`80d777ad-b5bf-476e-9c95-6c8d2a247174`::finished: {'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/577e8169-cbb0-401a-8aff-c6fdeaf4697f/df5b7676-a495-4383-bae9-acc1ae2dc830'} >Thread-67::DEBUG::2014-06-04 11:06:52,491::task::595::TaskManager.Task::(_updateState) Task=`80d777ad-b5bf-476e-9c95-6c8d2a247174`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-06-04 11:06:52,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-67::DEBUG::2014-06-04 11:06:52,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-06-04 11:06:52,492::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-67::DEBUG::2014-06-04 11:06:52,492::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-67::DEBUG::2014-06-04 11:06:52,492::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-67::DEBUG::2014-06-04 11:06:52,492::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-67::DEBUG::2014-06-04 11:06:52,492::task::990::TaskManager.Task::(_decref) Task=`80d777ad-b5bf-476e-9c95-6c8d2a247174`::ref 0 aborting False >Thread-68::DEBUG::2014-06-04 11:06:52,721::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-68::DEBUG::2014-06-04 11:06:52,721::task::595::TaskManager.Task::(_updateState) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::moving from state init -> state preparing >Thread-68::INFO::2014-06-04 11:06:52,721::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', size=52428800, volFormat=5, preallocate=1, diskType=2, volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', desc='Hosted Engine Image', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-68::DEBUG::2014-06-04 11:06:52,722::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`bd075387-9b39-4054-a397-105b8df8f6e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1453' at 'createVolume' >Thread-68::DEBUG::2014-06-04 11:06:52,722::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-68::DEBUG::2014-06-04 11:06:52,722::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-68::DEBUG::2014-06-04 11:06:52,722::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`bd075387-9b39-4054-a397-105b8df8f6e3`::Granted request >Thread-68::DEBUG::2014-06-04 11:06:52,723::task::827::TaskManager.Task::(resourceAcquired) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-68::DEBUG::2014-06-04 11:06:52,723::task::990::TaskManager.Task::(_decref) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::ref 1 aborting False >Thread-68::DEBUG::2014-06-04 11:06:52,725::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >Thread-68::DEBUG::2014-06-04 11:06:52,767::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-68::INFO::2014-06-04 11:06:52,767::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-68::DEBUG::2014-06-04 11:06:52,767::task::1180::TaskManager.Task::(prepare) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::Prepare: 1 jobs exist, move to acquiring >Thread-68::DEBUG::2014-06-04 11:06:52,767::task::595::TaskManager.Task::(_updateState) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::moving from state preparing -> state acquiring >Thread-68::DEBUG::2014-06-04 11:06:52,768::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >Thread-68::DEBUG::2014-06-04 11:06:52,800::task::595::TaskManager.Task::(_updateState) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::moving from state acquiring -> state queued >Thread-68::DEBUG::2014-06-04 11:06:52,801::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >Thread-68::DEBUG::2014-06-04 11:06:52,834::taskManager::50::TaskManager::(_queueTask) queuing task: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-68::DEBUG::2014-06-04 11:06:52,834::taskManager::56::TaskManager::(_queueTask) task queued: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-1::DEBUG::2014-06-04 11:06:52,834::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,835::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: fd7279eb-b4f8-4138-ab44-00342644f214 running: <bound method Task.commit of <storage.task.Task instance at 0x7f5f4c138c68>> with: None >Thread-68::DEBUG::2014-06-04 11:06:52,835::task::1182::TaskManager.Task::(prepare) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::returning >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,836::task::1194::TaskManager.Task::(commit) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::committing task: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-68::DEBUG::2014-06-04 11:06:52,836::task::990::TaskManager.Task::(_decref) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::ref 0 aborting False >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,837::task::595::TaskManager.Task::(_updateState) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::moving from state queued -> state running >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,840::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,875::task::905::TaskManager.Task::(_runJobs) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x23ef0d0>> (args: ('831ef374-8947-47f2-938f-5ec938f4fcef', '43819d41-ad14-495b-8a53-0832945a6050', 52428800, 5, 1, 2, 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'Hosted Engine Image', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,876::task::331::TaskManager.Task::(run) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x23ef0d0>> (args: ('831ef374-8947-47f2-938f-5ec938f4fcef', '43819d41-ad14-495b-8a53-0832945a6050', 52428800, 5, 1, 2, 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'Hosted Engine Image', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,876::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050`ReqID=`117b9b9c-d923-46e6-9596-124a4ff29734`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1758' at 'createVolume' >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,876::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050' for lock type 'exclusive' >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,877::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,877::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-69::DEBUG::2014-06-04 11:06:52,887::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-69::DEBUG::2014-06-04 11:06:52,888::task::595::TaskManager.Task::(_updateState) Task=`ae88efea-4840-47e6-b33e-f87ed23af877`::moving from state init -> state preparing >Thread-69::INFO::2014-06-04 11:06:52,888::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-69::DEBUG::2014-06-04 11:06:52,888::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-69::DEBUG::2014-06-04 11:06:52,888::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-69::DEBUG::2014-06-04 11:06:52,888::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'} >Thread-69::DEBUG::2014-06-04 11:06:52,889::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}} >Thread-69::INFO::2014-06-04 11:06:52,889::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}}} >Thread-69::DEBUG::2014-06-04 11:06:52,889::task::1185::TaskManager.Task::(prepare) Task=`ae88efea-4840-47e6-b33e-f87ed23af877`::finished: {'allTasksStatus': {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}}} >Thread-69::DEBUG::2014-06-04 11:06:52,889::task::595::TaskManager.Task::(_updateState) Task=`ae88efea-4840-47e6-b33e-f87ed23af877`::moving from state preparing -> state finished >Thread-69::DEBUG::2014-06-04 11:06:52,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-69::DEBUG::2014-06-04 11:06:52,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2014-06-04 11:06:52,889::task::990::TaskManager.Task::(_decref) Task=`ae88efea-4840-47e6-b33e-f87ed23af877`::ref 0 aborting False >Thread-29::DEBUG::2014-06-04 11:06:52,972::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:52,996::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,002::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,002::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,003::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 43819d41-ad14-495b-8a53-0832945a6050 does not exist in domain 831ef374-8947-47f2-938f-5ec938f4fcef >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,003::resourceManager::601::ResourceManager::(registerResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050' is free. Now locking as 'exclusive' (1 active user) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,003::resourceManager::238::ResourceManager.Request::(grant) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050`ReqID=`117b9b9c-d923-46e6-9596-124a4ff29734`::Granted request >fd7279eb-b4f8-4138-ab44-00342644f214::INFO::2014-06-04 11:06:53,003::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050 for image's volumes >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,004::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >fd7279eb-b4f8-4138-ab44-00342644f214::INFO::2014-06-04 11:06:53,025::volume::443::Storage.Volume::(create) Creating volume ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,026::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,069::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >Thread-29::DEBUG::2014-06-04 11:06:53,091::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:06:53,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-29::DEBUG::2014-06-04 11:06:53,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000961382 s, 4.3 MB/s\n'; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:06:53,102::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-29::DEBUG::2014-06-04 11:06:53,103::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,111::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 25600m --addtag OVIRT_VOL_INITIALIZING --name ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-29::DEBUG::2014-06-04 11:06:53,218::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-29::DEBUG::2014-06-04 11:06:53,219::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,291::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,292::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,292::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,292::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,293::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::WARNING::2014-06-04 11:06:53,293::utils::129::root::(rmFile) File: /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 already removed >fd7279eb-b4f8-4138-ab44-00342644f214::INFO::2014-06-04 11:06:53,293::blockVolume::161::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 with size = 52428800 sectors >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,294::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,294::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,418::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,425::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,426::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::WARNING::2014-06-04 11:06:53,426::blockSD::766::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,426::blockSD::789::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 6 in VG 831ef374-8947-47f2-938f-5ec938f4fcef >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,427::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_6 --addtag IU_43819d41-ad14-495b-8a53-0832945a6050 --addtag PU_00000000-0000-0000-0000-000000000000 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:53,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-45::DEBUG::2014-06-04 11:06:53,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108433 s, 9.4 MB/s\n'; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,641::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,641::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,641::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,642::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,768::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,769::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,769::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,769::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,770::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,882::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,890::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,890::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,891::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:53,938::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 sdUUID=831ef374-8947-47f2-938f-5ec938f4fcef, metaId=('831ef374-8947-47f2-938f-5ec938f4fcef', 6) >Thread-70::DEBUG::2014-06-04 11:06:53,939::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-70::DEBUG::2014-06-04 11:06:53,940::task::595::TaskManager.Task::(_updateState) Task=`2428c686-b13c-4e5f-97eb-9ca6428cd77a`::moving from state init -> state preparing >Thread-70::INFO::2014-06-04 11:06:53,940::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-70::DEBUG::2014-06-04 11:06:53,940::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-70::DEBUG::2014-06-04 11:06:53,940::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-70::DEBUG::2014-06-04 11:06:53,940::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'} >Thread-70::DEBUG::2014-06-04 11:06:53,940::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}} >Thread-70::INFO::2014-06-04 11:06:53,940::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}}} >Thread-70::DEBUG::2014-06-04 11:06:53,940::task::1185::TaskManager.Task::(prepare) Task=`2428c686-b13c-4e5f-97eb-9ca6428cd77a`::finished: {'allTasksStatus': {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}}} >Thread-70::DEBUG::2014-06-04 11:06:53,941::task::595::TaskManager.Task::(_updateState) Task=`2428c686-b13c-4e5f-97eb-9ca6428cd77a`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-06-04 11:06:53,941::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-06-04 11:06:53,941::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-06-04 11:06:53,941::task::990::TaskManager.Task::(_decref) Task=`2428c686-b13c-4e5f-97eb-9ca6428cd77a`::ref 0 aborting False >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,030::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,172::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050' >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,172::resourceManager::635::ResourceManager::(releaseResource) Released resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050' (0 active users) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,172::resourceManager::641::ResourceManager::(releaseResource) Resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050' is free, finding out if anyone is waiting for it. >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,173::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.43819d41-ad14-495b-8a53-0832945a6050', Clearing records. >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,173::task::595::TaskManager.Task::(_updateState) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::moving from state running -> state finished >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,173::task::752::TaskManager.Task::(_save) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::_save: orig /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214 temp /rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/master/tasks/fd7279eb-b4f8-4138-ab44-00342644f214.temp >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,208::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::task::913::TaskManager.Task::(_runJobs) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::Task.run: exit - success: result {'uuid': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'} >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::task::990::TaskManager.Task::(_decref) Task=`fd7279eb-b4f8-4138-ab44-00342644f214`::ref 0 aborting False >fd7279eb-b4f8-4138-ab44-00342644f214::DEBUG::2014-06-04 11:06:54,209::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-71::DEBUG::2014-06-04 11:06:54,990::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-71::DEBUG::2014-06-04 11:06:54,991::task::595::TaskManager.Task::(_updateState) Task=`340c2d8b-91ec-4d56-a0c1-2e162119836d`::moving from state init -> state preparing >Thread-71::INFO::2014-06-04 11:06:54,991::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-71::DEBUG::2014-06-04 11:06:54,991::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-71::DEBUG::2014-06-04 11:06:54,991::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-71::DEBUG::2014-06-04 11:06:54,991::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'} >Thread-71::DEBUG::2014-06-04 11:06:54,991::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}} >Thread-71::INFO::2014-06-04 11:06:54,992::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}}} >Thread-71::DEBUG::2014-06-04 11:06:54,992::task::1185::TaskManager.Task::(prepare) Task=`340c2d8b-91ec-4d56-a0c1-2e162119836d`::finished: {'allTasksStatus': {'fd7279eb-b4f8-4138-ab44-00342644f214': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd7279eb-b4f8-4138-ab44-00342644f214'}}} >Thread-71::DEBUG::2014-06-04 11:06:54,992::task::595::TaskManager.Task::(_updateState) Task=`340c2d8b-91ec-4d56-a0c1-2e162119836d`::moving from state preparing -> state finished >Thread-71::DEBUG::2014-06-04 11:06:54,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-71::DEBUG::2014-06-04 11:06:54,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-71::DEBUG::2014-06-04 11:06:54,992::task::990::TaskManager.Task::(_decref) Task=`340c2d8b-91ec-4d56-a0c1-2e162119836d`::ref 0 aborting False >Thread-72::DEBUG::2014-06-04 11:06:55,040::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-72::DEBUG::2014-06-04 11:06:55,040::task::595::TaskManager.Task::(_updateState) Task=`36e5eda2-9831-4d4a-a54a-005f10883943`::moving from state init -> state preparing >Thread-72::INFO::2014-06-04 11:06:55,041::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='fd7279eb-b4f8-4138-ab44-00342644f214', spUUID=None, options=None) >Thread-72::DEBUG::2014-06-04 11:06:55,041::taskManager::161::TaskManager::(clearTask) Entry. taskID: fd7279eb-b4f8-4138-ab44-00342644f214 >Thread-72::DEBUG::2014-06-04 11:06:55,042::taskManager::166::TaskManager::(clearTask) Return. >Thread-72::INFO::2014-06-04 11:06:55,042::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-72::DEBUG::2014-06-04 11:06:55,042::task::1185::TaskManager.Task::(prepare) Task=`36e5eda2-9831-4d4a-a54a-005f10883943`::finished: None >Thread-72::DEBUG::2014-06-04 11:06:55,042::task::595::TaskManager.Task::(_updateState) Task=`36e5eda2-9831-4d4a-a54a-005f10883943`::moving from state preparing -> state finished >Thread-72::DEBUG::2014-06-04 11:06:55,042::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-72::DEBUG::2014-06-04 11:06:55,043::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-72::DEBUG::2014-06-04 11:06:55,043::task::990::TaskManager.Task::(_decref) Task=`36e5eda2-9831-4d4a-a54a-005f10883943`::ref 0 aborting False >Thread-73::DEBUG::2014-06-04 11:06:55,092::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-73::DEBUG::2014-06-04 11:06:55,092::task::595::TaskManager.Task::(_updateState) Task=`3bc29c3e-d9ac-41f3-9608-95193a25453a`::moving from state init -> state preparing >Thread-73::INFO::2014-06-04 11:06:55,093::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-73::DEBUG::2014-06-04 11:06:55,093::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-73::DEBUG::2014-06-04 11:06:55,093::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {} >Thread-73::INFO::2014-06-04 11:06:55,093::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} >Thread-73::DEBUG::2014-06-04 11:06:55,093::task::1185::TaskManager.Task::(prepare) Task=`3bc29c3e-d9ac-41f3-9608-95193a25453a`::finished: {'allTasksStatus': {}} >Thread-73::DEBUG::2014-06-04 11:06:55,093::task::595::TaskManager.Task::(_updateState) Task=`3bc29c3e-d9ac-41f3-9608-95193a25453a`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-06-04 11:06:55,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-06-04 11:06:55,094::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-06-04 11:06:55,094::task::990::TaskManager.Task::(_decref) Task=`3bc29c3e-d9ac-41f3-9608-95193a25453a`::ref 0 aborting False >Thread-74::DEBUG::2014-06-04 11:06:55,142::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-74::DEBUG::2014-06-04 11:06:55,142::task::595::TaskManager.Task::(_updateState) Task=`2c54cf6a-7267-4190-b515-6e58960aa9f8`::moving from state init -> state preparing >Thread-74::INFO::2014-06-04 11:06:55,143::logUtils::44::dispatcher::(wrapper) Run and protect: spmStop(spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', options=None) >Thread-74::DEBUG::2014-06-04 11:06:55,143::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`028be29e-a38c-4500-a2c0-e58739689615`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '605' at 'spmStop' >Thread-74::DEBUG::2014-06-04 11:06:55,143::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-74::DEBUG::2014-06-04 11:06:55,144::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >Thread-74::DEBUG::2014-06-04 11:06:55,144::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`028be29e-a38c-4500-a2c0-e58739689615`::Granted request >Thread-74::DEBUG::2014-06-04 11:06:55,144::task::827::TaskManager.Task::(resourceAcquired) Task=`2c54cf6a-7267-4190-b515-6e58960aa9f8`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (exclusive) >Thread-74::DEBUG::2014-06-04 11:06:55,144::task::990::TaskManager.Task::(_decref) Task=`2c54cf6a-7267-4190-b515-6e58960aa9f8`::ref 1 aborting False >Thread-74::DEBUG::2014-06-04 11:06:55,144::sp::336::Storage.StoragePool::(_shutDownUpgrade) Shutting down upgrade process >Thread-74::DEBUG::2014-06-04 11:06:55,145::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`53f3058d-f1c7-4ce6-88c7-3924e8e35bf7`::Request was made in '/usr/share/vdsm/storage/sp.py' line '338' at '_shutDownUpgrade' >Thread-74::DEBUG::2014-06-04 11:06:55,145::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-74::DEBUG::2014-06-04 11:06:55,145::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >Thread-74::DEBUG::2014-06-04 11:06:55,145::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`53f3058d-f1c7-4ce6-88c7-3924e8e35bf7`::Granted request >Thread-74::DEBUG::2014-06-04 11:06:55,146::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-74::DEBUG::2014-06-04 11:06:55,146::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-74::DEBUG::2014-06-04 11:06:55,146::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-74::DEBUG::2014-06-04 11:06:55,146::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-74::DEBUG::2014-06-04 11:06:55,148::sp::374::Storage.StoragePool::(cleanupMasterMount) unmounting /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master >Thread-74::DEBUG::2014-06-04 11:06:55,428::mount::226::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/umount /rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master' (cwd None) >Thread-74::DEBUG::2014-06-04 11:06:55,490::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-74::DEBUG::2014-06-04 11:06:55,490::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-74::DEBUG::2014-06-04 11:06:55,490::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=4096', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'ROLE=Master', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-74::DEBUG::2014-06-04 11:06:55,490::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,490::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,491::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,491::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,491::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,491::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-74::DEBUG::2014-06-04 11:06:55,608::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-06-04 11:06:55,609::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,610::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537, MDT_POOL_SPM_ID=-1 removing=MDT__SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511, MDT_POOL_SPM_ID=1 >Thread-74::DEBUG::2014-06-04 11:06:55,611::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT_POOL_SPM_ID=1 --deltag MDT__SHA_CKSUM=600a4f609859674ad8c4de2053c306b38215c511 --addtag MDT_POOL_SPM_ID=-1 --addtag MDT__SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-74::DEBUG::2014-06-04 11:06:55,832::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-74::DEBUG::2014-06-04 11:06:55,833::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,837::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-74::DEBUG::2014-06-04 11:06:55,837::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-74::INFO::2014-06-04 11:06:55,837::clusterlock::279::SANLock::(release) Releasing cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-74::DEBUG::2014-06-04 11:06:55,875::clusterlock::289::SANLock::(release) Cluster lock for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully released >Thread-74::INFO::2014-06-04 11:06:55,875::logUtils::47::dispatcher::(wrapper) Run and protect: spmStop, Return response: None >Thread-74::DEBUG::2014-06-04 11:06:55,875::task::1185::TaskManager.Task::(prepare) Task=`2c54cf6a-7267-4190-b515-6e58960aa9f8`::finished: None >Thread-74::DEBUG::2014-06-04 11:06:55,875::task::595::TaskManager.Task::(_updateState) Task=`2c54cf6a-7267-4190-b515-6e58960aa9f8`::moving from state preparing -> state finished >Thread-74::DEBUG::2014-06-04 11:06:55,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-74::DEBUG::2014-06-04 11:06:55,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2014-06-04 11:06:55,876::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-74::DEBUG::2014-06-04 11:06:55,876::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-74::DEBUG::2014-06-04 11:06:55,876::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-74::DEBUG::2014-06-04 11:06:55,876::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-74::DEBUG::2014-06-04 11:06:55,876::task::990::TaskManager.Task::(_decref) Task=`2c54cf6a-7267-4190-b515-6e58960aa9f8`::ref 0 aborting False >Thread-75::DEBUG::2014-06-04 11:06:55,926::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-75::DEBUG::2014-06-04 11:06:55,927::task::595::TaskManager.Task::(_updateState) Task=`1c7a2578-e343-4c92-8844-9477c37bff9d`::moving from state init -> state preparing >Thread-75::INFO::2014-06-04 11:06:55,927::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', hostID=1, remove=False, options=None) >Thread-75::DEBUG::2014-06-04 11:06:55,928::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`03605506-f9b4-47ce-b127-eef8d4ca721c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1120' at 'disconnectStoragePool' >Thread-75::DEBUG::2014-06-04 11:06:55,928::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'exclusive' >Thread-75::DEBUG::2014-06-04 11:06:55,928::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'exclusive' (1 active user) >Thread-75::DEBUG::2014-06-04 11:06:55,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`03605506-f9b4-47ce-b127-eef8d4ca721c`::Granted request >Thread-75::DEBUG::2014-06-04 11:06:55,929::task::827::TaskManager.Task::(resourceAcquired) Task=`1c7a2578-e343-4c92-8844-9477c37bff9d`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (exclusive) >Thread-75::DEBUG::2014-06-04 11:06:55,929::task::990::TaskManager.Task::(_decref) Task=`1c7a2578-e343-4c92-8844-9477c37bff9d`::ref 1 aborting False >Thread-75::DEBUG::2014-06-04 11:06:55,929::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`d76dd063-d1a5-440e-8a55-b4b1b29f9f96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1128' at '_disconnectPool' >Thread-75::DEBUG::2014-06-04 11:06:55,929::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-75::DEBUG::2014-06-04 11:06:55,929::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-75::DEBUG::2014-06-04 11:06:55,930::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`d76dd063-d1a5-440e-8a55-b4b1b29f9f96`::Granted request >Thread-75::INFO::2014-06-04 11:06:55,930::sp::644::Storage.StoragePool::(disconnect) Disconnect from the storage pool 32dab0ff-9eaa-41c7-ae50-4e6ef6355512 >Dummy-45::INFO::2014-06-04 11:06:56,693::storage_mailbox::794::Storage.MailBox.SpmMailMonitor::(run) SPM_MailMonitor - Incoming mail monitoring thread stopped >Thread-37::INFO::2014-06-04 11:06:56,700::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-37::INFO::2014-06-04 11:06:56,701::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-37::DEBUG::2014-06-04 11:06:56,701::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-37::DEBUG::2014-06-04 11:06:56,709::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00343742 s, 1.2 MB/s\n'; <rc> = 0 >Thread-75::INFO::2014-06-04 11:06:57,686::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-29::DEBUG::2014-06-04 11:06:57,687::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-29::INFO::2014-06-04 11:06:57,687::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 1) >Thread-29::DEBUG::2014-06-04 11:07:00,688::clusterlock::217::SANLock::(releaseHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef released successfully (id: 1) >Thread-75::DEBUG::2014-06-04 11:07:00,688::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-75::DEBUG::2014-06-04 11:07:00,688::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-75::DEBUG::2014-06-04 11:07:00,688::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-75::DEBUG::2014-06-04 11:07:00,689::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-75::INFO::2014-06-04 11:07:00,689::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True >Thread-75::DEBUG::2014-06-04 11:07:00,689::task::1185::TaskManager.Task::(prepare) Task=`1c7a2578-e343-4c92-8844-9477c37bff9d`::finished: True >Thread-75::DEBUG::2014-06-04 11:07:00,689::task::595::TaskManager.Task::(_updateState) Task=`1c7a2578-e343-4c92-8844-9477c37bff9d`::moving from state preparing -> state finished >Thread-75::DEBUG::2014-06-04 11:07:00,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-75::DEBUG::2014-06-04 11:07:00,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-75::DEBUG::2014-06-04 11:07:00,690::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-75::DEBUG::2014-06-04 11:07:00,690::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-75::DEBUG::2014-06-04 11:07:00,690::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-75::DEBUG::2014-06-04 11:07:00,690::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-75::DEBUG::2014-06-04 11:07:00,690::task::990::TaskManager.Task::(_decref) Task=`1c7a2578-e343-4c92-8844-9477c37bff9d`::ref 0 aborting False >Thread-76::DEBUG::2014-06-04 11:07:00,742::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-76::DEBUG::2014-06-04 11:07:00,743::task::595::TaskManager.Task::(_updateState) Task=`21147db3-1afb-4c11-b02c-914e98eefde9`::moving from state init -> state preparing >Thread-76::INFO::2014-06-04 11:07:00,743::logUtils::44::dispatcher::(wrapper) Run and protect: startMonitoringDomain(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', hostID=1, options=None) >Thread-76::DEBUG::2014-06-04 11:07:00,743::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`022fff0b-d965-4569-9819-ea4cd2434372`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3673' at 'startMonitoringDomain' >Thread-76::DEBUG::2014-06-04 11:07:00,743::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-76::DEBUG::2014-06-04 11:07:00,744::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-76::DEBUG::2014-06-04 11:07:00,744::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`022fff0b-d965-4569-9819-ea4cd2434372`::Granted request >Thread-76::INFO::2014-06-04 11:07:00,744::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:07:00,744::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:07:00,745::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-76::DEBUG::2014-06-04 11:07:00,745::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-77::DEBUG::2014-06-04 11:07:00,745::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-76::DEBUG::2014-06-04 11:07:00,746::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-76::DEBUG::2014-06-04 11:07:00,750::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-76::DEBUG::2014-06-04 11:07:00,750::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-76::INFO::2014-06-04 11:07:00,750::logUtils::47::dispatcher::(wrapper) Run and protect: startMonitoringDomain, Return response: None >Thread-76::DEBUG::2014-06-04 11:07:00,750::task::1185::TaskManager.Task::(prepare) Task=`21147db3-1afb-4c11-b02c-914e98eefde9`::finished: None >Thread-76::DEBUG::2014-06-04 11:07:00,751::task::595::TaskManager.Task::(_updateState) Task=`21147db3-1afb-4c11-b02c-914e98eefde9`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-06-04 11:07:00,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-76::DEBUG::2014-06-04 11:07:00,751::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-06-04 11:07:00,751::task::990::TaskManager.Task::(_decref) Task=`21147db3-1afb-4c11-b02c-914e98eefde9`::ref 0 aborting False >Thread-77::DEBUG::2014-06-04 11:07:00,860::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:07:00,861::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:07:00,864::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:07:00,871::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000951677 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:07:00,874::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 831ef374-8947-47f2-938f-5ec938f4fcef changed its status to Valid >Thread-78::DEBUG::2014-06-04 11:07:00,874::misc::884::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-77::INFO::2014-06-04 11:07:00,874::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 1) >Thread-78::DEBUG::2014-06-04 11:07:00,875::misc::894::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-77::DEBUG::2014-06-04 11:07:00,876::clusterlock::202::SANLock::(acquireHostId) Host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef successfully acquired (id: 1) >Thread-78::DEBUG::2014-06-04 11:07:00,877::misc::904::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-79::INFO::2014-06-04 11:07:00,884::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-80::DEBUG::2014-06-04 11:07:05,806::task::595::TaskManager.Task::(_updateState) Task=`282c3d4c-9e88-466e-aa0f-9c8c59b1441b`::moving from state init -> state preparing >Thread-80::INFO::2014-06-04 11:07:05,845::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-80::INFO::2014-06-04 11:07:05,845::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000951677', 'lastCheck': '5.0', 'valid': True}} >Thread-80::DEBUG::2014-06-04 11:07:05,845::task::1185::TaskManager.Task::(prepare) Task=`282c3d4c-9e88-466e-aa0f-9c8c59b1441b`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000951677', 'lastCheck': '5.0', 'valid': True}} >Thread-80::DEBUG::2014-06-04 11:07:05,845::task::595::TaskManager.Task::(_updateState) Task=`282c3d4c-9e88-466e-aa0f-9c8c59b1441b`::moving from state preparing -> state finished >Thread-80::DEBUG::2014-06-04 11:07:05,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-80::DEBUG::2014-06-04 11:07:05,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-80::DEBUG::2014-06-04 11:07:05,845::task::990::TaskManager.Task::(_decref) Task=`282c3d4c-9e88-466e-aa0f-9c8c59b1441b`::ref 0 aborting False >Thread-80::ERROR::2014-06-04 11:07:05,846::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1599, in _getHaInfo > host_id = instance.get_local_host_id() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id > self._config = config.Config() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ > self._load(Config.static_files) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load > with open(fname, 'r') as f: >IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' >Thread-77::DEBUG::2014-06-04 11:07:10,880::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:07:10,889::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102369 s, 4.0 MB/s\n'; <rc> = 0 >Thread-81::DEBUG::2014-06-04 11:07:10,907::task::595::TaskManager.Task::(_updateState) Task=`50de88f7-d55f-4341-bcaf-c91aa3d876e9`::moving from state init -> state preparing >Thread-81::INFO::2014-06-04 11:07:10,907::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2014-06-04 11:07:10,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00102369', 'lastCheck': '0.0', 'valid': True}} >Thread-81::DEBUG::2014-06-04 11:07:10,907::task::1185::TaskManager.Task::(prepare) Task=`50de88f7-d55f-4341-bcaf-c91aa3d876e9`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00102369', 'lastCheck': '0.0', 'valid': True}} >Thread-81::DEBUG::2014-06-04 11:07:10,907::task::595::TaskManager.Task::(_updateState) Task=`50de88f7-d55f-4341-bcaf-c91aa3d876e9`::moving from state preparing -> state finished >Thread-81::DEBUG::2014-06-04 11:07:10,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2014-06-04 11:07:10,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2014-06-04 11:07:10,908::task::990::TaskManager.Task::(_decref) Task=`50de88f7-d55f-4341-bcaf-c91aa3d876e9`::ref 0 aborting False >Thread-81::ERROR::2014-06-04 11:07:10,909::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1599, in _getHaInfo > host_id = instance.get_local_host_id() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id > self._config = config.Config() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ > self._load(Config.static_files) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load > with open(fname, 'r') as f: >IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' >Thread-82::DEBUG::2014-06-04 11:07:15,968::task::595::TaskManager.Task::(_updateState) Task=`71c1a0dd-8fa6-4549-a8d5-ca25cbde40a8`::moving from state init -> state preparing >Thread-82::INFO::2014-06-04 11:07:15,969::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-82::INFO::2014-06-04 11:07:15,969::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00102369', 'lastCheck': '5.1', 'valid': True}} >Thread-82::DEBUG::2014-06-04 11:07:15,969::task::1185::TaskManager.Task::(prepare) Task=`71c1a0dd-8fa6-4549-a8d5-ca25cbde40a8`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00102369', 'lastCheck': '5.1', 'valid': True}} >Thread-82::DEBUG::2014-06-04 11:07:15,969::task::595::TaskManager.Task::(_updateState) Task=`71c1a0dd-8fa6-4549-a8d5-ca25cbde40a8`::moving from state preparing -> state finished >Thread-82::DEBUG::2014-06-04 11:07:15,969::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-82::DEBUG::2014-06-04 11:07:15,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-82::DEBUG::2014-06-04 11:07:15,970::task::990::TaskManager.Task::(_decref) Task=`71c1a0dd-8fa6-4549-a8d5-ca25cbde40a8`::ref 0 aborting False >Thread-82::ERROR::2014-06-04 11:07:15,971::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1599, in _getHaInfo > host_id = instance.get_local_host_id() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id > self._config = config.Config() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ > self._load(Config.static_files) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load > with open(fname, 'r') as f: >IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' >Thread-77::DEBUG::2014-06-04 11:07:20,895::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:07:20,901::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000953687 s, 4.3 MB/s\n'; <rc> = 0 >Thread-83::DEBUG::2014-06-04 11:07:21,031::task::595::TaskManager.Task::(_updateState) Task=`237cde5e-dc0f-4bb0-8913-ff9b73680f33`::moving from state init -> state preparing >Thread-83::INFO::2014-06-04 11:07:21,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-83::INFO::2014-06-04 11:07:21,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000953687', 'lastCheck': '0.1', 'valid': True}} >Thread-83::DEBUG::2014-06-04 11:07:21,032::task::1185::TaskManager.Task::(prepare) Task=`237cde5e-dc0f-4bb0-8913-ff9b73680f33`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000953687', 'lastCheck': '0.1', 'valid': True}} >Thread-83::DEBUG::2014-06-04 11:07:21,032::task::595::TaskManager.Task::(_updateState) Task=`237cde5e-dc0f-4bb0-8913-ff9b73680f33`::moving from state preparing -> state finished >Thread-83::DEBUG::2014-06-04 11:07:21,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-83::DEBUG::2014-06-04 11:07:21,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-83::DEBUG::2014-06-04 11:07:21,032::task::990::TaskManager.Task::(_decref) Task=`237cde5e-dc0f-4bb0-8913-ff9b73680f33`::ref 0 aborting False >Thread-83::ERROR::2014-06-04 11:07:21,033::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1599, in _getHaInfo > host_id = instance.get_local_host_id() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id > self._config = config.Config() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ > self._load(Config.static_files) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load > with open(fname, 'r') as f: >IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' >Thread-84::DEBUG::2014-06-04 11:07:26,094::task::595::TaskManager.Task::(_updateState) Task=`22fdb48c-9443-4cd0-be13-21e0e709dd94`::moving from state init -> state preparing >Thread-84::INFO::2014-06-04 11:07:26,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-84::INFO::2014-06-04 11:07:26,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000953687', 'lastCheck': '5.2', 'valid': True}} >Thread-84::DEBUG::2014-06-04 11:07:26,094::task::1185::TaskManager.Task::(prepare) Task=`22fdb48c-9443-4cd0-be13-21e0e709dd94`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000953687', 'lastCheck': '5.2', 'valid': True}} >Thread-84::DEBUG::2014-06-04 11:07:26,094::task::595::TaskManager.Task::(_updateState) Task=`22fdb48c-9443-4cd0-be13-21e0e709dd94`::moving from state preparing -> state finished >Thread-84::DEBUG::2014-06-04 11:07:26,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-84::DEBUG::2014-06-04 11:07:26,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2014-06-04 11:07:26,095::task::990::TaskManager.Task::(_decref) Task=`22fdb48c-9443-4cd0-be13-21e0e709dd94`::ref 0 aborting False >Thread-84::ERROR::2014-06-04 11:07:26,095::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1599, in _getHaInfo > host_id = instance.get_local_host_id() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id > self._config = config.Config() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ > self._load(Config.static_files) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load > with open(fname, 'r') as f: >IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' >Thread-77::DEBUG::2014-06-04 11:07:30,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:07:30,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107128 s, 3.8 MB/s\n'; <rc> = 0 >Thread-85::DEBUG::2014-06-04 11:07:31,155::task::595::TaskManager.Task::(_updateState) Task=`8bcc336c-595a-4a2e-844d-81904b8e79a6`::moving from state init -> state preparing >Thread-85::INFO::2014-06-04 11:07:31,155::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-85::INFO::2014-06-04 11:07:31,156::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107128', 'lastCheck': '0.2', 'valid': True}} >Thread-85::DEBUG::2014-06-04 11:07:31,156::task::1185::TaskManager.Task::(prepare) Task=`8bcc336c-595a-4a2e-844d-81904b8e79a6`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107128', 'lastCheck': '0.2', 'valid': True}} >Thread-85::DEBUG::2014-06-04 11:07:31,156::task::595::TaskManager.Task::(_updateState) Task=`8bcc336c-595a-4a2e-844d-81904b8e79a6`::moving from state preparing -> state finished >Thread-85::DEBUG::2014-06-04 11:07:31,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-85::DEBUG::2014-06-04 11:07:31,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-85::DEBUG::2014-06-04 11:07:31,157::task::990::TaskManager.Task::(_decref) Task=`8bcc336c-595a-4a2e-844d-81904b8e79a6`::ref 0 aborting False >Thread-85::ERROR::2014-06-04 11:07:31,158::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1599, in _getHaInfo > host_id = instance.get_local_host_id() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 217, in get_local_host_id > self._config = config.Config() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 63, in __init__ > self._load(Config.static_files) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/env/config.py", line 69, in _load > with open(fname, 'r') as f: >IOError: [Errno 2] No such file or directory: '/etc/ovirt-hosted-engine/hosted-engine.conf' >Thread-86::DEBUG::2014-06-04 11:07:36,768::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-86::DEBUG::2014-06-04 11:07:36,768::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-87::DEBUG::2014-06-04 11:07:36,909::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmCreate with ({'emulatedMachine': 'pc', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'devices': [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': '96e15463-a912-40e0-b459-3f24b29e12ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050', 'specParams': {}, 'readonly': 'false', 'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'deviceId': '43819d41-ad14-495b-8a53-0832945a6050', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:1a:4c:10:3f:11', 'linkActive': 'true', 'network': 'ovirtmgmt', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'd5e77b15-41d7-4f4a-b212-74336cecdfe9', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': '0bb4d7ee-e7b2-47a7-b05a-4127f1d4d2c4', 'alias': 'console0'}], 'smp': '2', 'memSize': '4096', 'cpuType': 'Conroe', 'spiceSecureChannels': 'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', 'vmName': 'HostedEngine', 'display': 'vnc'},) {} >Thread-87::INFO::2014-06-04 11:07:36,913::API::668::vds::(_getNetworkIp) network None: using 0 >Thread-87::INFO::2014-06-04 11:07:36,913::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >Thread-87::DEBUG::2014-06-04 11:07:36,914::libvirtconnection::145::root::(get) trying to connect libvirt >Thread-88::DEBUG::2014-06-04 11:07:36,957::vm::2242::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start >Thread-87::DEBUG::2014-06-04 11:07:36,957::clientIF::379::vds::(createVm) Total desktops after creation of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 1 >Thread-88::DEBUG::2014-06-04 11:07:36,958::vm::2246::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations acquired >Thread-87::DEBUG::2014-06-04 11:07:36,958::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'nicModel': 'rtl8139,pv', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'emulatedMachine': 'pc', 'displayIp': '0', 'pid': '0', 'devices': [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': '96e15463-a912-40e0-b459-3f24b29e12ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050', 'specParams': {}, 'readonly': 'false', 'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'deviceId': '43819d41-ad14-495b-8a53-0832945a6050', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:1a:4c:10:3f:11', 'linkActive': 'true', 'network': 'ovirtmgmt', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'd5e77b15-41d7-4f4a-b212-74336cecdfe9', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': '0bb4d7ee-e7b2-47a7-b05a-4127f1d4d2c4', 'alias': 'console0'}], 'smp': '2', 'vmType': 'kvm', 'displaySecurePort': '-1', 'memSize': '4096', 'displayPort': '-1', 'cpuType': 'Conroe', 'spiceSecureChannels': 'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', 'clientIp': '', 'vmName': 'HostedEngine', 'display': 'vnc'}} >Thread-88::INFO::2014-06-04 11:07:36,958::vm::3097::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::VM wrapper has started >Thread-88::DEBUG::2014-06-04 11:07:36,961::task::595::TaskManager.Task::(_updateState) Task=`ea37226f-14d7-449b-b516-b2609f03ee57`::moving from state init -> state preparing >Thread-88::INFO::2014-06-04 11:07:36,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-88::DEBUG::2014-06-04 11:07:36,964::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-88::DEBUG::2014-06-04 11:07:36,968::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-88::DEBUG::2014-06-04 11:07:37,101::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-90::DEBUG::2014-06-04 11:07:37,109::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-88::DEBUG::2014-06-04 11:07:37,113::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-88::DEBUG::2014-06-04 11:07:37,113::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-90::ERROR::2014-06-04 11:07:37,111::BindingXMLRPC::1086::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 314, in vmSetTicket > return vm.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/API.py", line 611, in setTicket > return v.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/vm.py", line 4480, in setTicket > graphics = _domParseStr(self._dom.XMLDesc(0)).childNodes[0]. \ >AttributeError: 'NoneType' object has no attribute 'XMLDesc' >Thread-88::INFO::2014-06-04 11:07:37,114::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-88::DEBUG::2014-06-04 11:07:37,116::task::1185::TaskManager.Task::(prepare) Task=`ea37226f-14d7-449b-b516-b2609f03ee57`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-88::DEBUG::2014-06-04 11:07:37,117::task::595::TaskManager.Task::(_updateState) Task=`ea37226f-14d7-449b-b516-b2609f03ee57`::moving from state preparing -> state finished >Thread-88::DEBUG::2014-06-04 11:07:37,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-88::DEBUG::2014-06-04 11:07:37,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-88::DEBUG::2014-06-04 11:07:37,118::task::990::TaskManager.Task::(_decref) Task=`ea37226f-14d7-449b-b516-b2609f03ee57`::ref 0 aborting False >Thread-88::INFO::2014-06-04 11:07:37,119::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-88::DEBUG::2014-06-04 11:07:37,119::task::595::TaskManager.Task::(_updateState) Task=`b8e4ec5d-5a40-488a-8b47-25b87fce67a3`::moving from state init -> state preparing >Thread-88::INFO::2014-06-04 11:07:37,119::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', leafUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6') >Thread-88::DEBUG::2014-06-04 11:07:37,120::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`83a2caf5-375b-499b-b912-7ff7afa0e22b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3237' at 'prepareImage' >Thread-88::DEBUG::2014-06-04 11:07:37,120::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-88::DEBUG::2014-06-04 11:07:37,120::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-88::DEBUG::2014-06-04 11:07:37,120::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`83a2caf5-375b-499b-b912-7ff7afa0e22b`::Granted request >Thread-88::DEBUG::2014-06-04 11:07:37,121::task::827::TaskManager.Task::(resourceAcquired) Task=`b8e4ec5d-5a40-488a-8b47-25b87fce67a3`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-88::DEBUG::2014-06-04 11:07:37,121::task::990::TaskManager.Task::(_decref) Task=`b8e4ec5d-5a40-488a-8b47-25b87fce67a3`::ref 1 aborting False >Thread-88::DEBUG::2014-06-04 11:07:37,121::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-88::DEBUG::2014-06-04 11:07:37,122::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-88::DEBUG::2014-06-04 11:07:37,237::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-88::DEBUG::2014-06-04 11:07:37,245::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-88::DEBUG::2014-06-04 11:07:37,245::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-88::DEBUG::2014-06-04 11:07:37,246::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >Thread-88::DEBUG::2014-06-04 11:07:37,473::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-88::DEBUG::2014-06-04 11:07:37,473::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-88::DEBUG::2014-06-04 11:07:37,474::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-88::DEBUG::2014-06-04 11:07:37,475::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-88::DEBUG::2014-06-04 11:07:37,476::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-88::DEBUG::2014-06-04 11:07:37,599::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-88::DEBUG::2014-06-04 11:07:37,608::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-88::DEBUG::2014-06-04 11:07:37,608::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-88::INFO::2014-06-04 11:07:37,609::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, 'path': '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imgVolumesInfo': [{'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}]} >Thread-88::DEBUG::2014-06-04 11:07:37,609::task::1185::TaskManager.Task::(prepare) Task=`b8e4ec5d-5a40-488a-8b47-25b87fce67a3`::finished: {'info': {'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, 'path': '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imgVolumesInfo': [{'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}]} >Thread-88::DEBUG::2014-06-04 11:07:37,610::task::595::TaskManager.Task::(_updateState) Task=`b8e4ec5d-5a40-488a-8b47-25b87fce67a3`::moving from state preparing -> state finished >Thread-88::DEBUG::2014-06-04 11:07:37,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-88::DEBUG::2014-06-04 11:07:37,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-88::DEBUG::2014-06-04 11:07:37,610::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-88::DEBUG::2014-06-04 11:07:37,610::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-88::DEBUG::2014-06-04 11:07:37,611::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-88::DEBUG::2014-06-04 11:07:37,611::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-88::DEBUG::2014-06-04 11:07:37,611::task::990::TaskManager.Task::(_decref) Task=`b8e4ec5d-5a40-488a-8b47-25b87fce67a3`::ref 0 aborting False >Thread-88::INFO::2014-06-04 11:07:37,611::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >Thread-88::DEBUG::2014-06-04 11:07:37,627::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_hostedengine' (cwd None) >Thread-88::DEBUG::2014-06-04 11:07:37,676::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-88::INFO::2014-06-04 11:07:37,676::hooks::100::root::(_runHooksDir) >Thread-88::DEBUG::2014-06-04 11:07:37,682::vm::3136::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::<?xml version="1.0" encoding="utf-8"?><domain type="kvm"> > <name>HostedEngine</name> > <uuid>8adf82c9-1900-4fd9-8ba4-d73b55146b5b</uuid> > <memory>4194304</memory> > <currentMemory>4194304</currentMemory> > <vcpu current="2">2</vcpu> > <memtune> > <min_guarantee>0</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <graphics autoport="yes" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" type="vnc"/> > <console type="pty"> > <target port="0" type="virtio"/> > </console> > <memballoon model="none"/> > <controller model="virtio-scsi" type="scsi"/> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > <mac address="00:1a:4c:10:3f:11"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <boot order="1"/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6"/> > <target bus="virtio" dev="vda"/> > <serial>43819d41-ad14-495b-8a53-0832945a6050</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> > </disk> > <lease> > <key>ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6</key> > <lockspace>831ef374-8947-47f2-938f-5ec938f4fcef</lockspace> > <target offset="111149056" path="/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases"/> > </lease> > </devices> > <os> > <type arch="x86_64" machine="pc">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">oVirt</entry> > <entry name="product">oVirt Node</entry> > <entry name="version">6-5.el6.centos.11.1</entry> > <entry name="serial">30303734-3536-5A43-3133-343330305658_a4:5d:36:11:e1:cc</entry> > <entry name="uuid">8adf82c9-1900-4fd9-8ba4-d73b55146b5b</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > </cpu> ><on_poweroff>destroy</on_poweroff><on_reboot>destroy</on_reboot><on_crash>destroy</on_crash></domain> >Thread-91::DEBUG::2014-06-04 11:07:38,282::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-91::ERROR::2014-06-04 11:07:38,288::BindingXMLRPC::1086::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 314, in vmSetTicket > return vm.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/API.py", line 611, in setTicket > return v.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/vm.py", line 4480, in setTicket > graphics = _domParseStr(self._dom.XMLDesc(0)).childNodes[0]. \ >AttributeError: 'NoneType' object has no attribute 'XMLDesc' >libvirtEventLoop::DEBUG::2014-06-04 11:07:38,623::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Started detail 0 opaque None >Thread-88::DEBUG::2014-06-04 11:07:38,637::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-88::DEBUG::2014-06-04 11:07:38,647::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-88::DEBUG::2014-06-04 11:07:38,647::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-88::DEBUG::2014-06-04 11:07:38,647::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'vda', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'type': u'disk'} >Thread-88::DEBUG::2014-06-04 11:07:38,647::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', u'disk')} >Thread-88::DEBUG::2014-06-04 11:07:38,647::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', 'disk')} >Thread-88::DEBUG::2014-06-04 11:07:38,672::sampling::285::vm.Vm::(start) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start statistics collection >Thread-92::DEBUG::2014-06-04 11:07:38,672::sampling::314::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread started >Thread-92::DEBUG::2014-06-04 11:07:38,673::task::595::TaskManager.Task::(_updateState) Task=`f84269a4-bbf0-40df-905c-f5ef9086f44a`::moving from state init -> state preparing >Thread-92::INFO::2014-06-04 11:07:38,673::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-92::INFO::2014-06-04 11:07:38,675::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-92::DEBUG::2014-06-04 11:07:38,675::task::1185::TaskManager.Task::(prepare) Task=`f84269a4-bbf0-40df-905c-f5ef9086f44a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-92::DEBUG::2014-06-04 11:07:38,675::task::595::TaskManager.Task::(_updateState) Task=`f84269a4-bbf0-40df-905c-f5ef9086f44a`::moving from state preparing -> state finished >Thread-92::DEBUG::2014-06-04 11:07:38,675::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-92::DEBUG::2014-06-04 11:07:38,675::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-92::DEBUG::2014-06-04 11:07:38,676::task::990::TaskManager.Task::(_decref) Task=`f84269a4-bbf0-40df-905c-f5ef9086f44a`::ref 0 aborting False >Thread-88::DEBUG::2014-06-04 11:07:38,689::vmChannels::194::vds::(register) Add fileno 16 to listener's channels. >Thread-88::WARNING::2014-06-04 11:07:38,691::vm::3661::vm.Vm::(_readPauseCode) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_readPauseCode unsupported by libvirt vm >Thread-88::DEBUG::2014-06-04 11:07:38,731::vm::2263::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations released >Thread-93::DEBUG::2014-06-04 11:07:39,444::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-93::DEBUG::2014-06-04 11:07:39,482::BindingXMLRPC::1074::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-94::DEBUG::2014-06-04 11:07:39,538::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-94::DEBUG::2014-06-04 11:07:39,538::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-94::DEBUG::2014-06-04 11:07:39,538::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-94::DEBUG::2014-06-04 11:07:39,539::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-94::DEBUG::2014-06-04 11:07:39,539::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-94::DEBUG::2014-06-04 11:07:39,539::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-94::DEBUG::2014-06-04 11:07:39,539::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-94::DEBUG::2014-06-04 11:07:39,539::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39110', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-8440254142898228354', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.87', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-06-04 11:07:39,634::vmChannels::102::vds::(_do_add_channels) fileno 16 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-06-04 11:07:39,634::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 16. >VM Channels Listener::DEBUG::2014-06-04 11:07:39,634::guestIF::147::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Attempting connection to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:07:39,635::guestIF::150::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Connected to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:07:39,636::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 16 succeeded. >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,669::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,669::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,669::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,670::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,670::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,670::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,670::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,671::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,671::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,671::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,671::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:40,671::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:07:40,920::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:07:40,928::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107145 s, 3.8 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,676::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,676::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,676::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:45,677::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,683::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,683::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,715::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,715::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,715::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,715::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,715::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,716::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,716::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,716::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,716::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:50,716::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:07:50,935::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:07:50,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107756 s, 3.8 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,722::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,722::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,749::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,749::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,750::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,750::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,750::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:07:55,750::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,756::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,784::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,785::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,785::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,785::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,785::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,786::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:00,786::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:08:00,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:08:00,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101776 s, 4.0 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,792::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,797::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,823::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,823::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,824::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,824::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,824::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:05,824::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-06-04 11:08:09,667::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,830::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,830::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,848::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,848::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,849::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,849::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,849::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:10,849::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:08:10,960::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:08:10,968::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104875 s, 3.9 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,855::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,855::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,873::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,873::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,874::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,874::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,874::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:15,874::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,880::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,880::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,907::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,907::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,907::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,907::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,908::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:20,908::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:08:20,975::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:08:20,981::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102764 s, 4.0 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,914::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,914::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,949::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,949::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,950::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,950::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,950::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:25,950::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,956::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,957::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,957::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,957::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,958::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,958::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,958::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:30,958::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:08:30,987::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:08:30,994::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112765 s, 3.6 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,964::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,964::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,964::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,964::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,965::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,965::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,965::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:08:35,965::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-92::DEBUG::2014-06-04 11:08:38,768::task::595::TaskManager.Task::(_updateState) Task=`46380855-02d3-4811-8e67-b7945ff53ec6`::moving from state init -> state preparing >Thread-92::INFO::2014-06-04 11:08:38,769::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-92::INFO::2014-06-04 11:08:38,770::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-92::DEBUG::2014-06-04 11:08:38,770::task::1185::TaskManager.Task::(prepare) Task=`46380855-02d3-4811-8e67-b7945ff53ec6`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-92::DEBUG::2014-06-04 11:08:38,770::task::595::TaskManager.Task::(_updateState) Task=`46380855-02d3-4811-8e67-b7945ff53ec6`::moving from state preparing -> state finished >Thread-92::DEBUG::2014-06-04 11:08:38,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-92::DEBUG::2014-06-04 11:08:38,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-92::DEBUG::2014-06-04 11:08:38,770::task::990::TaskManager.Task::(_decref) Task=`46380855-02d3-4811-8e67-b7945ff53ec6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:08:39,698::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:08:41,000::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:08:41,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101371 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:08:51,027::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:08:51,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105496 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:09:01,039::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:09:01,047::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00154708 s, 2.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:09:09,731::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:09:11,052::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:09:11,059::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00121405 s, 3.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:09:21,064::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:09:21,071::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105494 s, 3.9 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:09:26,288::clientIF::555::vm.Vm::(dispatchLibvirtEvents) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::graphics event phase 0 localAddr {'node': '0.0.0.0', 'service': '5900', 'family': 0} remoteAddr {'node': '10.34.131.221', 'service': '58116', 'family': 0}authScheme vnc subject [] >Thread-77::DEBUG::2014-06-04 11:09:31,077::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:09:31,084::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113195 s, 3.6 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:09:32,364::clientIF::555::vm.Vm::(dispatchLibvirtEvents) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::graphics event phase 1 localAddr {'node': '0.0.0.0', 'service': '5900', 'family': 0} remoteAddr {'node': '10.34.131.221', 'service': '58116', 'family': 0}authScheme vnc subject [] >Thread-95::DEBUG::2014-06-04 11:09:35,384::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmDestroy with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-95::INFO::2014-06-04 11:09:35,385::API::327::vds::(destroy) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >Thread-95::DEBUG::2014-06-04 11:09:35,385::vm::4629::vm.Vm::(destroy) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::destroy Called >Thread-95::INFO::2014-06-04 11:09:35,385::vm::4575::vm.Vm::(releaseVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Release VM resources >Thread-95::DEBUG::2014-06-04 11:09:35,394::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >Thread-92::DEBUG::2014-06-04 11:09:35,394::sampling::323::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread finished >Thread-95::DEBUG::2014-06-04 11:09:35,394::vmChannels::205::vds::(unregister) Delete fileno 16 from listener. >VM Channels Listener::DEBUG::2014-06-04 11:09:35,758::vmChannels::112::vds::(_do_del_channels) fileno 16 was removed from listener. >Thread-95::DEBUG::2014-06-04 11:09:35,957::task::595::TaskManager.Task::(_updateState) Task=`a2fbf91a-92a8-4584-9384-d013929f441d`::moving from state init -> state preparing >libvirtEventLoop::DEBUG::2014-06-04 11:09:35,957::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Stopped detail 1 opaque None >Thread-95::INFO::2014-06-04 11:09:35,957::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID=None) >libvirtEventLoop::INFO::2014-06-04 11:09:35,958::vm::2324::vm.Vm::(_onQemuDeath) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::underlying process disconnected >Thread-95::DEBUG::2014-06-04 11:09:35,958::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`5e07d05d-6fac-4498-99e0-f054eed12d90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3285' at 'teardownImage' >Thread-95::DEBUG::2014-06-04 11:09:35,958::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-95::DEBUG::2014-06-04 11:09:35,959::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-95::DEBUG::2014-06-04 11:09:35,959::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`5e07d05d-6fac-4498-99e0-f054eed12d90`::Granted request >Thread-95::DEBUG::2014-06-04 11:09:35,959::task::827::TaskManager.Task::(resourceAcquired) Task=`a2fbf91a-92a8-4584-9384-d013929f441d`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-95::DEBUG::2014-06-04 11:09:35,959::task::990::TaskManager.Task::(_decref) Task=`a2fbf91a-92a8-4584-9384-d013929f441d`::ref 1 aborting False >Thread-95::DEBUG::2014-06-04 11:09:35,960::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-95::DEBUG::2014-06-04 11:09:35,960::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-95::DEBUG::2014-06-04 11:09:36,117::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-95::DEBUG::2014-06-04 11:09:36,124::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-95::DEBUG::2014-06-04 11:09:36,125::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-95::DEBUG::2014-06-04 11:09:36,125::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >Thread-95::DEBUG::2014-06-04 11:09:36,265::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-95::DEBUG::2014-06-04 11:09:36,265::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-95::DEBUG::2014-06-04 11:09:36,266::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-95::INFO::2014-06-04 11:09:36,266::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-95::DEBUG::2014-06-04 11:09:36,266::task::1185::TaskManager.Task::(prepare) Task=`a2fbf91a-92a8-4584-9384-d013929f441d`::finished: None >Thread-95::DEBUG::2014-06-04 11:09:36,266::task::595::TaskManager.Task::(_updateState) Task=`a2fbf91a-92a8-4584-9384-d013929f441d`::moving from state preparing -> state finished >Thread-95::DEBUG::2014-06-04 11:09:36,267::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-95::DEBUG::2014-06-04 11:09:36,267::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-95::DEBUG::2014-06-04 11:09:36,267::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-95::DEBUG::2014-06-04 11:09:36,268::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-95::DEBUG::2014-06-04 11:09:36,268::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-95::DEBUG::2014-06-04 11:09:36,268::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-95::DEBUG::2014-06-04 11:09:36,268::task::990::TaskManager.Task::(_decref) Task=`a2fbf91a-92a8-4584-9384-d013929f441d`::ref 0 aborting False >Thread-95::DEBUG::2014-06-04 11:09:36,270::task::595::TaskManager.Task::(_updateState) Task=`4b9377ac-fa55-4cbc-b1e3-fccd227bb651`::moving from state init -> state preparing >Thread-95::INFO::2014-06-04 11:09:36,271::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='8adf82c9-1900-4fd9-8ba4-d73b55146b5b') >Thread-95::INFO::2014-06-04 11:09:36,285::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-95::DEBUG::2014-06-04 11:09:36,285::task::1185::TaskManager.Task::(prepare) Task=`4b9377ac-fa55-4cbc-b1e3-fccd227bb651`::finished: None >Thread-95::DEBUG::2014-06-04 11:09:36,285::task::595::TaskManager.Task::(_updateState) Task=`4b9377ac-fa55-4cbc-b1e3-fccd227bb651`::moving from state preparing -> state finished >Thread-95::DEBUG::2014-06-04 11:09:36,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-95::DEBUG::2014-06-04 11:09:36,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-95::DEBUG::2014-06-04 11:09:36,286::task::990::TaskManager.Task::(_decref) Task=`4b9377ac-fa55-4cbc-b1e3-fccd227bb651`::ref 0 aborting False >Thread-95::DEBUG::2014-06-04 11:09:36,287::vm::4623::vm.Vm::(deleteVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Total desktops after destroy of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 0 >Thread-95::DEBUG::2014-06-04 11:09:36,287::BindingXMLRPC::1074::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >libvirtEventLoop::DEBUG::2014-06-04 11:09:36,291::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:09:36,292::vm::2731::vm.Vm::(setDownStatus) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Changed state to Down: Admin shut down >libvirtEventLoop::DEBUG::2014-06-04 11:09:36,293::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-06-04 11:09:36,295::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >Thread-77::DEBUG::2014-06-04 11:09:41,090::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:09:41,097::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110895 s, 3.7 MB/s\n'; <rc> = 0 >Thread-96::DEBUG::2014-06-04 11:09:41,371::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-96::DEBUG::2014-06-04 11:09:41,371::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-97::DEBUG::2014-06-04 11:09:41,516::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmCreate with ({'emulatedMachine': 'pc', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'devices': [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': '96e15463-a912-40e0-b459-3f24b29e12ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050', 'specParams': {}, 'readonly': 'false', 'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'deviceId': '43819d41-ad14-495b-8a53-0832945a6050', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:1a:4c:10:3f:11', 'linkActive': 'true', 'network': 'ovirtmgmt', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'd5e77b15-41d7-4f4a-b212-74336cecdfe9', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': '0bb4d7ee-e7b2-47a7-b05a-4127f1d4d2c4', 'alias': 'console0'}], 'smp': '2', 'memSize': '4096', 'cpuType': 'Conroe', 'spiceSecureChannels': 'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', 'vmName': 'HostedEngine', 'display': 'vnc'},) {} >Thread-97::INFO::2014-06-04 11:09:41,520::API::668::vds::(_getNetworkIp) network None: using 0 >Thread-97::INFO::2014-06-04 11:09:41,521::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >Thread-97::DEBUG::2014-06-04 11:09:41,525::clientIF::379::vds::(createVm) Total desktops after creation of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 1 >Thread-98::DEBUG::2014-06-04 11:09:41,525::vm::2242::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start >Thread-97::DEBUG::2014-06-04 11:09:41,526::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'nicModel': 'rtl8139,pv', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'emulatedMachine': 'pc', 'displayIp': '0', 'pid': '0', 'devices': [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': '96e15463-a912-40e0-b459-3f24b29e12ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050', 'specParams': {}, 'readonly': 'false', 'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'deviceId': '43819d41-ad14-495b-8a53-0832945a6050', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:1a:4c:10:3f:11', 'linkActive': 'true', 'network': 'ovirtmgmt', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'd5e77b15-41d7-4f4a-b212-74336cecdfe9', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': '0bb4d7ee-e7b2-47a7-b05a-4127f1d4d2c4', 'alias': 'console0'}], 'smp': '2', 'vmType': 'kvm', 'displaySecurePort': '-1', 'memSize': '4096', 'displayPort': '-1', 'cpuType': 'Conroe', 'spiceSecureChannels': 'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', 'clientIp': '', 'vmName': 'HostedEngine', 'display': 'vnc'}} >Thread-98::DEBUG::2014-06-04 11:09:41,526::vm::2246::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations acquired >Thread-98::INFO::2014-06-04 11:09:41,528::vm::3097::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::VM wrapper has started >Thread-98::DEBUG::2014-06-04 11:09:41,530::task::595::TaskManager.Task::(_updateState) Task=`f6c6fa41-03bc-44be-8655-b2803b1bdb1a`::moving from state init -> state preparing >Thread-98::INFO::2014-06-04 11:09:41,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-98::DEBUG::2014-06-04 11:09:41,533::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-98::DEBUG::2014-06-04 11:09:41,536::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-98::DEBUG::2014-06-04 11:09:41,665::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-98::DEBUG::2014-06-04 11:09:41,673::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-98::DEBUG::2014-06-04 11:09:41,673::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-98::INFO::2014-06-04 11:09:41,674::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-98::DEBUG::2014-06-04 11:09:41,674::task::1185::TaskManager.Task::(prepare) Task=`f6c6fa41-03bc-44be-8655-b2803b1bdb1a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-98::DEBUG::2014-06-04 11:09:41,674::task::595::TaskManager.Task::(_updateState) Task=`f6c6fa41-03bc-44be-8655-b2803b1bdb1a`::moving from state preparing -> state finished >Thread-98::DEBUG::2014-06-04 11:09:41,674::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-98::DEBUG::2014-06-04 11:09:41,675::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-98::DEBUG::2014-06-04 11:09:41,675::task::990::TaskManager.Task::(_decref) Task=`f6c6fa41-03bc-44be-8655-b2803b1bdb1a`::ref 0 aborting False >Thread-98::INFO::2014-06-04 11:09:41,676::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-100::DEBUG::2014-06-04 11:09:41,677::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-98::DEBUG::2014-06-04 11:09:41,678::task::595::TaskManager.Task::(_updateState) Task=`8f343aea-5c6e-4e7d-880d-c6cb06252129`::moving from state init -> state preparing >Thread-98::INFO::2014-06-04 11:09:41,679::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', leafUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6') >Thread-98::DEBUG::2014-06-04 11:09:41,680::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`8774b31e-4e56-4327-95b1-24c371b1300f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3237' at 'prepareImage' >Thread-98::DEBUG::2014-06-04 11:09:41,680::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-100::ERROR::2014-06-04 11:09:41,678::BindingXMLRPC::1086::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 314, in vmSetTicket > return vm.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/API.py", line 611, in setTicket > return v.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/vm.py", line 4480, in setTicket > graphics = _domParseStr(self._dom.XMLDesc(0)).childNodes[0]. \ >AttributeError: 'NoneType' object has no attribute 'XMLDesc' >Thread-98::DEBUG::2014-06-04 11:09:41,681::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-98::DEBUG::2014-06-04 11:09:41,682::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`8774b31e-4e56-4327-95b1-24c371b1300f`::Granted request >Thread-98::DEBUG::2014-06-04 11:09:41,684::task::827::TaskManager.Task::(resourceAcquired) Task=`8f343aea-5c6e-4e7d-880d-c6cb06252129`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-98::DEBUG::2014-06-04 11:09:41,684::task::990::TaskManager.Task::(_decref) Task=`8f343aea-5c6e-4e7d-880d-c6cb06252129`::ref 1 aborting False >Thread-98::DEBUG::2014-06-04 11:09:41,684::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-98::DEBUG::2014-06-04 11:09:41,685::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-98::DEBUG::2014-06-04 11:09:41,805::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-98::DEBUG::2014-06-04 11:09:41,813::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-98::DEBUG::2014-06-04 11:09:41,814::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-98::DEBUG::2014-06-04 11:09:41,814::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >Thread-98::DEBUG::2014-06-04 11:09:42,040::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-98::DEBUG::2014-06-04 11:09:42,041::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-98::DEBUG::2014-06-04 11:09:42,046::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-98::WARNING::2014-06-04 11:09:42,047::fileUtils::167::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050 already exists >Thread-98::DEBUG::2014-06-04 11:09:42,047::blockSD::1091::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >Thread-98::DEBUG::2014-06-04 11:09:42,047::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-98::DEBUG::2014-06-04 11:09:42,048::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-98::DEBUG::2014-06-04 11:09:42,161::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-98::DEBUG::2014-06-04 11:09:42,169::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-98::DEBUG::2014-06-04 11:09:42,170::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-98::INFO::2014-06-04 11:09:42,171::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, 'path': '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imgVolumesInfo': [{'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}]} >Thread-98::DEBUG::2014-06-04 11:09:42,172::task::1185::TaskManager.Task::(prepare) Task=`8f343aea-5c6e-4e7d-880d-c6cb06252129`::finished: {'info': {'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, 'path': '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imgVolumesInfo': [{'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}]} >Thread-98::DEBUG::2014-06-04 11:09:42,172::task::595::TaskManager.Task::(_updateState) Task=`8f343aea-5c6e-4e7d-880d-c6cb06252129`::moving from state preparing -> state finished >Thread-98::DEBUG::2014-06-04 11:09:42,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-98::DEBUG::2014-06-04 11:09:42,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-98::DEBUG::2014-06-04 11:09:42,173::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-98::DEBUG::2014-06-04 11:09:42,173::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-98::DEBUG::2014-06-04 11:09:42,173::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-98::DEBUG::2014-06-04 11:09:42,173::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-98::DEBUG::2014-06-04 11:09:42,173::task::990::TaskManager.Task::(_decref) Task=`8f343aea-5c6e-4e7d-880d-c6cb06252129`::ref 0 aborting False >Thread-98::INFO::2014-06-04 11:09:42,174::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >Thread-98::DEBUG::2014-06-04 11:09:42,188::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_hostedengine' (cwd None) >Thread-98::DEBUG::2014-06-04 11:09:42,235::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-98::INFO::2014-06-04 11:09:42,236::hooks::100::root::(_runHooksDir) >Thread-98::DEBUG::2014-06-04 11:09:42,240::vm::3136::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::<?xml version="1.0" encoding="utf-8"?><domain type="kvm"> > <name>HostedEngine</name> > <uuid>8adf82c9-1900-4fd9-8ba4-d73b55146b5b</uuid> > <memory>4194304</memory> > <currentMemory>4194304</currentMemory> > <vcpu current="2">2</vcpu> > <memtune> > <min_guarantee>0</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <graphics autoport="yes" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" type="vnc"/> > <console type="pty"> > <target port="0" type="virtio"/> > </console> > <memballoon model="none"/> > <controller model="virtio-scsi" type="scsi"/> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > <mac address="00:1a:4c:10:3f:11"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <boot order="1"/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6"/> > <target bus="virtio" dev="vda"/> > <serial>43819d41-ad14-495b-8a53-0832945a6050</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> > </disk> > <lease> > <key>ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6</key> > <lockspace>831ef374-8947-47f2-938f-5ec938f4fcef</lockspace> > <target offset="111149056" path="/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases"/> > </lease> > </devices> > <os> > <type arch="x86_64" machine="pc">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">oVirt</entry> > <entry name="product">oVirt Node</entry> > <entry name="version">6-5.el6.centos.11.1</entry> > <entry name="serial">30303734-3536-5A43-3133-343330305658_a4:5d:36:11:e1:cc</entry> > <entry name="uuid">8adf82c9-1900-4fd9-8ba4-d73b55146b5b</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > </cpu> ><on_poweroff>destroy</on_poweroff><on_reboot>destroy</on_reboot><on_crash>destroy</on_crash></domain> >Thread-101::DEBUG::2014-06-04 11:09:42,846::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-101::ERROR::2014-06-04 11:09:42,846::BindingXMLRPC::1086::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 314, in vmSetTicket > return vm.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/API.py", line 611, in setTicket > return v.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/vm.py", line 4480, in setTicket > graphics = _domParseStr(self._dom.XMLDesc(0)).childNodes[0]. \ >AttributeError: 'NoneType' object has no attribute 'XMLDesc' >libvirtEventLoop::DEBUG::2014-06-04 11:09:43,193::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Started detail 0 opaque None >Thread-98::DEBUG::2014-06-04 11:09:43,207::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-98::DEBUG::2014-06-04 11:09:43,217::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-98::DEBUG::2014-06-04 11:09:43,217::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-98::DEBUG::2014-06-04 11:09:43,218::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'vda', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'type': u'disk'} >Thread-98::DEBUG::2014-06-04 11:09:43,218::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', u'disk')} >Thread-98::DEBUG::2014-06-04 11:09:43,218::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', 'disk')} >Thread-98::DEBUG::2014-06-04 11:09:43,276::sampling::285::vm.Vm::(start) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start statistics collection >Thread-102::DEBUG::2014-06-04 11:09:43,276::sampling::314::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread started >Thread-102::DEBUG::2014-06-04 11:09:43,277::task::595::TaskManager.Task::(_updateState) Task=`dd4f1636-05d6-4bcb-b7ec-1767b737b9b3`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:09:43,277::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:09:43,278::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:09:43,278::task::1185::TaskManager.Task::(prepare) Task=`dd4f1636-05d6-4bcb-b7ec-1767b737b9b3`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:09:43,278::task::595::TaskManager.Task::(_updateState) Task=`dd4f1636-05d6-4bcb-b7ec-1767b737b9b3`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:09:43,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:09:43,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:09:43,278::task::990::TaskManager.Task::(_decref) Task=`dd4f1636-05d6-4bcb-b7ec-1767b737b9b3`::ref 0 aborting False >Thread-98::DEBUG::2014-06-04 11:09:43,290::vmChannels::194::vds::(register) Add fileno 16 to listener's channels. >Thread-98::WARNING::2014-06-04 11:09:43,294::vm::3661::vm.Vm::(_readPauseCode) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_readPauseCode unsupported by libvirt vm >Thread-98::DEBUG::2014-06-04 11:09:43,343::vm::2263::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-06-04 11:09:43,766::vmChannels::102::vds::(_do_add_channels) fileno 16 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-06-04 11:09:43,766::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 16. >VM Channels Listener::DEBUG::2014-06-04 11:09:43,767::guestIF::147::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Attempting connection to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:09:43,768::guestIF::150::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Connected to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:09:43,768::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 16 succeeded. >Thread-103::DEBUG::2014-06-04 11:09:44,002::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-103::DEBUG::2014-06-04 11:09:44,035::BindingXMLRPC::1074::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-104::DEBUG::2014-06-04 11:09:44,091::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-104::DEBUG::2014-06-04 11:09:44,091::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-104::DEBUG::2014-06-04 11:09:44,092::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-104::DEBUG::2014-06-04 11:09:44,092::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-104::DEBUG::2014-06-04 11:09:44,092::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-104::DEBUG::2014-06-04 11:09:44,092::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-104::DEBUG::2014-06-04 11:09:44,092::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-104::DEBUG::2014-06-04 11:09:44,093::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39485', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-8440254142898228354', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.81', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,791::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,791::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,791::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,791::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,792::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,792::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,792::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,792::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,792::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,793::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,793::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:45,793::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,798::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,799::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,800::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,800::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:50,800::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:09:51,103::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:09:51,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00117401 s, 3.5 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,805::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,806::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,834::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,834::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,835::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,835::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,835::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,835::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,836::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,836::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,836::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:09:55,836::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,842::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,842::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,867::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,867::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,868::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,868::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,868::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:00,868::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:10:01,114::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:10:01,121::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107018 s, 3.8 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,874::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,874::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,875::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,875::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,875::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,875::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,876::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:05,876::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,881::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,882::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,882::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,882::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,882::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,883::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,883::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:10,883::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:10:11,127::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:10:11,134::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107427 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:10:13,800::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,889::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,889::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,917::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,917::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,918::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,918::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,918::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:15,918::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >libvirtEventLoop::DEBUG::2014-06-04 11:10:19,396::clientIF::555::vm.Vm::(dispatchLibvirtEvents) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::graphics event phase 0 localAddr {'node': '0.0.0.0', 'service': '5900', 'family': 0} remoteAddr {'node': '10.34.131.221', 'service': '58117', 'family': 0}authScheme vnc subject [] >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,924::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,924::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,958::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,958::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,959::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,959::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,959::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:20,959::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:10:21,145::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:10:21,153::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115662 s, 3.5 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:10:21,696::clientIF::555::vm.Vm::(dispatchLibvirtEvents) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::graphics event phase 1 localAddr {'node': '0.0.0.0', 'service': '5900', 'family': 0} remoteAddr {'node': '10.34.131.221', 'service': '58117', 'family': 0}authScheme vnc subject [] >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,965::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,965::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,990::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,990::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,991::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,991::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,991::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:25,991::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:30,997::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:30,997::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:31,024::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:31,024::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:31,025::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:31,025::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:31,025::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:31,025::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:10:31,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:10:31,163::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100087 s, 4.1 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,031::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,031::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,049::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,049::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,050::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,050::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,050::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:36,050::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,053::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,054::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,054::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,054::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,054::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,054::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,055::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:10:41,055::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:10:41,167::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:10:41,174::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110094 s, 3.7 MB/s\n'; <rc> = 0 >Thread-102::DEBUG::2014-06-04 11:10:43,373::task::595::TaskManager.Task::(_updateState) Task=`004753e2-5d18-47e0-8921-d778f7d5b09b`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:10:43,374::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:10:43,375::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:10:43,375::task::1185::TaskManager.Task::(prepare) Task=`004753e2-5d18-47e0-8921-d778f7d5b09b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:10:43,375::task::595::TaskManager.Task::(_updateState) Task=`004753e2-5d18-47e0-8921-d778f7d5b09b`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:10:43,375::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:10:43,375::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:10:43,375::task::990::TaskManager.Task::(_decref) Task=`004753e2-5d18-47e0-8921-d778f7d5b09b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:10:43,832::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:10:51,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:10:51,186::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107029 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:11:01,192::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:11:02,080::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.881698 s, 4.6 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:11:12,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:11:12,127::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0359685 s, 114 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:11:13,864::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:11:22,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:11:22,455::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.317017 s, 12.9 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:11:32,459::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:11:32,902::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.436393 s, 9.4 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:11:42,908::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-102::DEBUG::2014-06-04 11:11:43,419::task::595::TaskManager.Task::(_updateState) Task=`b505b136-2777-4f96-8b5b-625fb4a1c829`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:11:43,419::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:11:43,419::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:11:43,420::task::1185::TaskManager.Task::(prepare) Task=`b505b136-2777-4f96-8b5b-625fb4a1c829`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:11:43,420::task::595::TaskManager.Task::(_updateState) Task=`b505b136-2777-4f96-8b5b-625fb4a1c829`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:11:43,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:11:43,420::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:11:43,420::task::990::TaskManager.Task::(_decref) Task=`b505b136-2777-4f96-8b5b-625fb4a1c829`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:11:43,897::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:11:44,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 1.20577 s, 3.4 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:11:54,123::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:11:54,267::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:11:54,269::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:11:54,276::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108512 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:04,279::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:12:04,280::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:12:04,281::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:04,286::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000807393 s, 2.5 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:04,286::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000807393 s, 2.5 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:12:04,286::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:12:04,286::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:12:04,287::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:12:04,287::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:12:04,287::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:12:04,287::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:12:04,287::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:12:04,288::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:12:04,288::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:04,395::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:04,396::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:12:04,396::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:12:04,397::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:12:04,397::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:12:04,397::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:12:04,398::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:04,511::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:04,513::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:04,519::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000927901 s, 4.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:12:13,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:12:14,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:14,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101211 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:24,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:25,370::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.831203 s, 4.9 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:35,376::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:36,717::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 1.33494 s, 3.1 kB/s\n'; <rc> = 0 >Thread-102::DEBUG::2014-06-04 11:12:43,467::task::595::TaskManager.Task::(_updateState) Task=`5369edcc-9fe3-48c7-85fd-b576aaf18a68`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:12:43,467::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:12:43,468::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:12:43,468::task::1185::TaskManager.Task::(prepare) Task=`5369edcc-9fe3-48c7-85fd-b576aaf18a68`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:12:43,468::task::595::TaskManager.Task::(_updateState) Task=`5369edcc-9fe3-48c7-85fd-b576aaf18a68`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:12:43,468::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:12:43,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:12:43,468::task::990::TaskManager.Task::(_decref) Task=`5369edcc-9fe3-48c7-85fd-b576aaf18a68`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:12:43,961::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:12:46,723::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:47,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.857029 s, 4.8 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:12:57,591::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:12:57,597::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979345 s, 4.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:13:07,601::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:13:07,607::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999551 s, 4.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:13:13,991::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:13:17,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:13:17,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000946368 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:13:27,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:13:27,803::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.175672 s, 23.3 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:13:37,808::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:13:38,090::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.275656 s, 14.9 kB/s\n'; <rc> = 0 >Thread-102::DEBUG::2014-06-04 11:13:43,509::task::595::TaskManager.Task::(_updateState) Task=`b2ebe1bc-89d2-4e8c-9a15-7815924bc739`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:13:43,509::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:13:43,542::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:13:43,542::task::1185::TaskManager.Task::(prepare) Task=`b2ebe1bc-89d2-4e8c-9a15-7815924bc739`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:13:43,542::task::595::TaskManager.Task::(_updateState) Task=`b2ebe1bc-89d2-4e8c-9a15-7815924bc739`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:13:43,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:13:43,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:13:43,543::task::990::TaskManager.Task::(_decref) Task=`b2ebe1bc-89d2-4e8c-9a15-7815924bc739`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:13:44,022::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:13:48,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:13:48,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106317 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:13:58,106::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:13:58,302::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.189575 s, 21.6 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:14:08,307::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:14:08,312::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102676 s, 4.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:14:14,054::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:14:18,316::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:14:18,321::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00093536 s, 4.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:14:28,325::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:14:28,528::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.196851 s, 20.8 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:14:38,532::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:14:38,675::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.137961 s, 29.7 kB/s\n'; <rc> = 0 >Thread-102::DEBUG::2014-06-04 11:14:43,611::task::595::TaskManager.Task::(_updateState) Task=`0af4e52b-de0d-443f-aea2-bf5d8eed73c0`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:14:43,611::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:14:43,642::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:14:43,643::task::1185::TaskManager.Task::(prepare) Task=`0af4e52b-de0d-443f-aea2-bf5d8eed73c0`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:14:43,643::task::595::TaskManager.Task::(_updateState) Task=`0af4e52b-de0d-443f-aea2-bf5d8eed73c0`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:14:43,643::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:14:43,643::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:14:43,643::task::990::TaskManager.Task::(_decref) Task=`0af4e52b-de0d-443f-aea2-bf5d8eed73c0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:14:44,085::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:14:48,681::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:14:48,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105464 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:14:58,711::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:14:58,904::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.187639 s, 21.8 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:15:08,908::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:15:09,697::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.784662 s, 5.2 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:15:14,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:15:19,701::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:15:19,846::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.138911 s, 29.5 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:15:29,852::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:15:29,859::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099322 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:15:39,864::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:15:40,108::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.237841 s, 17.2 kB/s\n'; <rc> = 0 >Thread-102::DEBUG::2014-06-04 11:15:43,678::task::595::TaskManager.Task::(_updateState) Task=`09c51210-b12c-4380-a344-655b1a66d9b6`::moving from state init -> state preparing >Thread-102::INFO::2014-06-04 11:15:43,678::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-102::INFO::2014-06-04 11:15:43,679::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:15:43,679::task::1185::TaskManager.Task::(prepare) Task=`09c51210-b12c-4380-a344-655b1a66d9b6`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-102::DEBUG::2014-06-04 11:15:43,679::task::595::TaskManager.Task::(_updateState) Task=`09c51210-b12c-4380-a344-655b1a66d9b6`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-06-04 11:15:43,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-06-04 11:15:43,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-06-04 11:15:43,679::task::990::TaskManager.Task::(_decref) Task=`09c51210-b12c-4380-a344-655b1a66d9b6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:15:44,148::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:15:50,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:15:50,120::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106328 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:16:00,125::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:00,148::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0171356 s, 239 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:16:10,153::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:10,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111198 s, 3.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:16:14,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:16:20,165::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:20,270::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.098979 s, 41.4 kB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:16:26,880::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Shutdown detail 0 opaque None >VM Channels Listener::ERROR::2014-06-04 11:16:26,985::vmChannels::53::vds::(_handle_event) Received 00000019 on fileno 16 >VM Channels Listener::DEBUG::2014-06-04 11:16:26,988::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 16. >VM Channels Listener::DEBUG::2014-06-04 11:16:26,988::guestIF::147::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Attempting connection to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:16:26,989::guestIF::158::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Failed to connect to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm with 111 >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,273::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Stopped detail 0 opaque None >libvirtEventLoop::INFO::2014-06-04 11:16:27,273::vm::2324::vm.Vm::(_onQemuDeath) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::underlying process disconnected >libvirtEventLoop::INFO::2014-06-04 11:16:27,274::vm::4575::vm.Vm::(releaseVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Release VM resources >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,278::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,278::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >Thread-102::DEBUG::2014-06-04 11:16:27,279::sampling::323::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread finished >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,279::vmChannels::205::vds::(unregister) Delete fileno 16 from listener. >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,280::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,280::task::595::TaskManager.Task::(_updateState) Task=`1f29c7e1-b2b1-401f-8cf8-89a5e43c86bc`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-06-04 11:16:27,280::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID=None) >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,281::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`424c00b1-9bbe-4995-84b9-49e383b42265`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3285' at 'teardownImage' >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,281::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,281::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,281::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`424c00b1-9bbe-4995-84b9-49e383b42265`::Granted request >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,282::task::827::TaskManager.Task::(resourceAcquired) Task=`1f29c7e1-b2b1-401f-8cf8-89a5e43c86bc`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,282::task::990::TaskManager.Task::(_decref) Task=`1f29c7e1-b2b1-401f-8cf8-89a5e43c86bc`::ref 1 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,282::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,283::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,412::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,421::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,421::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,422::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,551::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,551::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,551::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >libvirtEventLoop::INFO::2014-06-04 11:16:27,552::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,552::task::1185::TaskManager.Task::(prepare) Task=`1f29c7e1-b2b1-401f-8cf8-89a5e43c86bc`::finished: None >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,552::task::595::TaskManager.Task::(_updateState) Task=`1f29c7e1-b2b1-401f-8cf8-89a5e43c86bc`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,552::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,553::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,553::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,553::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,553::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,554::task::990::TaskManager.Task::(_decref) Task=`1f29c7e1-b2b1-401f-8cf8-89a5e43c86bc`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,555::task::595::TaskManager.Task::(_updateState) Task=`f567a9c9-7f73-482b-a140-7ff366a0a805`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-06-04 11:16:27,555::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='8adf82c9-1900-4fd9-8ba4-d73b55146b5b') >libvirtEventLoop::INFO::2014-06-04 11:16:27,569::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,569::task::1185::TaskManager.Task::(prepare) Task=`f567a9c9-7f73-482b-a140-7ff366a0a805`::finished: None >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,569::task::595::TaskManager.Task::(_updateState) Task=`f567a9c9-7f73-482b-a140-7ff366a0a805`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,569::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,569::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,570::task::990::TaskManager.Task::(_decref) Task=`f567a9c9-7f73-482b-a140-7ff366a0a805`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,601::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,602::vm::2731::vm.Vm::(setDownStatus) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Changed state to Down: User shut down >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,602::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-06-04 11:16:27,607::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >VM Channels Listener::DEBUG::2014-06-04 11:16:27,990::vmChannels::112::vds::(_do_del_channels) fileno 16 was removed from listener. >Thread-77::DEBUG::2014-06-04 11:16:30,275::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:30,282::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112804 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:16:40,288::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:40,295::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993965 s, 4.1 MB/s\n'; <rc> = 0 >Thread-105::DEBUG::2014-06-04 11:16:44,619::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-105::DEBUG::2014-06-04 11:16:44,620::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'hash': '-8440254142898228354', 'exitMessage': 'User shut down', 'exitCode': 0}]} >Thread-106::DEBUG::2014-06-04 11:16:44,764::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmDestroy with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-106::INFO::2014-06-04 11:16:44,764::API::327::vds::(destroy) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >Thread-106::DEBUG::2014-06-04 11:16:44,765::vm::4629::vm.Vm::(destroy) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::destroy Called >Thread-106::DEBUG::2014-06-04 11:16:44,765::vm::4623::vm.Vm::(deleteVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Total desktops after destroy of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 0 >Thread-106::DEBUG::2014-06-04 11:16:44,765::BindingXMLRPC::1074::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >Thread-107::DEBUG::2014-06-04 11:16:49,857::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-107::DEBUG::2014-06-04 11:16:49,858::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-108::DEBUG::2014-06-04 11:16:49,993::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmCreate with ({'emulatedMachine': 'pc', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'devices': [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': '96e15463-a912-40e0-b459-3f24b29e12ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'format': 'raw', 'bootOrder': '1', 'poolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050', 'specParams': {}, 'readonly': 'false', 'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'optional': 'false', 'deviceId': '43819d41-ad14-495b-8a53-0832945a6050', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:1a:4c:10:3f:11', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'd5e77b15-41d7-4f4a-b212-74336cecdfe9', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': '0bb4d7ee-e7b2-47a7-b05a-4127f1d4d2c4', 'alias': 'console0'}], 'smp': '2', 'memSize': '4096', 'cpuType': 'Conroe', 'spiceSecureChannels': 'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', 'vmName': 'HostedEngine', 'display': 'vnc'},) {} >Thread-108::INFO::2014-06-04 11:16:50,001::API::668::vds::(_getNetworkIp) network None: using 0 >Thread-108::INFO::2014-06-04 11:16:50,001::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >Thread-108::DEBUG::2014-06-04 11:16:50,005::clientIF::379::vds::(createVm) Total desktops after creation of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 1 >Thread-109::DEBUG::2014-06-04 11:16:50,005::vm::2242::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start >Thread-108::DEBUG::2014-06-04 11:16:50,005::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'nicModel': 'rtl8139,pv', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'emulatedMachine': 'pc', 'displayIp': '0', 'pid': '0', 'devices': [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': '96e15463-a912-40e0-b459-3f24b29e12ae', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'format': 'raw', 'bootOrder': '1', 'poolID': '00000000-0000-0000-0000-000000000000', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050', 'specParams': {}, 'readonly': 'false', 'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'optional': 'false', 'deviceId': '43819d41-ad14-495b-8a53-0832945a6050', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'type': 'disk'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:1a:4c:10:3f:11', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'd5e77b15-41d7-4f4a-b212-74336cecdfe9', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': '0bb4d7ee-e7b2-47a7-b05a-4127f1d4d2c4', 'alias': 'console0'}], 'smp': '2', 'vmType': 'kvm', 'displaySecurePort': '-1', 'memSize': '4096', 'displayPort': '-1', 'cpuType': 'Conroe', 'spiceSecureChannels': 'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', 'clientIp': '', 'vmName': 'HostedEngine', 'display': 'vnc'}} >Thread-109::DEBUG::2014-06-04 11:16:50,006::vm::2246::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations acquired >Thread-109::INFO::2014-06-04 11:16:50,007::vm::3097::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::VM wrapper has started >Thread-109::DEBUG::2014-06-04 11:16:50,010::task::595::TaskManager.Task::(_updateState) Task=`8d5171d4-bf39-435c-a593-5de3611cdccd`::moving from state init -> state preparing >Thread-109::INFO::2014-06-04 11:16:50,011::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-109::DEBUG::2014-06-04 11:16:50,013::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2014-06-04 11:16:50,016::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-109::DEBUG::2014-06-04 11:16:50,142::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-06-04 11:16:50,147::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-109::DEBUG::2014-06-04 11:16:50,147::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-109::INFO::2014-06-04 11:16:50,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-109::DEBUG::2014-06-04 11:16:50,148::task::1185::TaskManager.Task::(prepare) Task=`8d5171d4-bf39-435c-a593-5de3611cdccd`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-109::DEBUG::2014-06-04 11:16:50,148::task::595::TaskManager.Task::(_updateState) Task=`8d5171d4-bf39-435c-a593-5de3611cdccd`::moving from state preparing -> state finished >Thread-109::DEBUG::2014-06-04 11:16:50,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-109::DEBUG::2014-06-04 11:16:50,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2014-06-04 11:16:50,148::task::990::TaskManager.Task::(_decref) Task=`8d5171d4-bf39-435c-a593-5de3611cdccd`::ref 0 aborting False >Thread-109::INFO::2014-06-04 11:16:50,148::clientIF::324::vds::(prepareVolumePath) prepared volume path: >Thread-109::DEBUG::2014-06-04 11:16:50,149::task::595::TaskManager.Task::(_updateState) Task=`01596128-2452-4579-b9b5-88ad8a2279ca`::moving from state init -> state preparing >Thread-109::INFO::2014-06-04 11:16:50,149::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', leafUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6') >Thread-109::DEBUG::2014-06-04 11:16:50,149::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`daac88b5-f749-4137-8ffb-135d2a17aa14`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3237' at 'prepareImage' >Thread-109::DEBUG::2014-06-04 11:16:50,149::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-109::DEBUG::2014-06-04 11:16:50,149::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-109::DEBUG::2014-06-04 11:16:50,149::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`daac88b5-f749-4137-8ffb-135d2a17aa14`::Granted request >Thread-109::DEBUG::2014-06-04 11:16:50,150::task::827::TaskManager.Task::(resourceAcquired) Task=`01596128-2452-4579-b9b5-88ad8a2279ca`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-109::DEBUG::2014-06-04 11:16:50,150::task::990::TaskManager.Task::(_decref) Task=`01596128-2452-4579-b9b5-88ad8a2279ca`::ref 1 aborting False >Thread-109::DEBUG::2014-06-04 11:16:50,150::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2014-06-04 11:16:50,150::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-111::DEBUG::2014-06-04 11:16:50,156::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-111::ERROR::2014-06-04 11:16:50,156::BindingXMLRPC::1086::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 314, in vmSetTicket > return vm.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/API.py", line 611, in setTicket > return v.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/vm.py", line 4480, in setTicket > graphics = _domParseStr(self._dom.XMLDesc(0)).childNodes[0]. \ >AttributeError: 'NoneType' object has no attribute 'XMLDesc' >Thread-109::DEBUG::2014-06-04 11:16:50,266::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-06-04 11:16:50,274::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-109::DEBUG::2014-06-04 11:16:50,274::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-109::DEBUG::2014-06-04 11:16:50,275::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:50,301::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:16:50,306::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000927728 s, 4.4 MB/s\n'; <rc> = 0 >Thread-109::DEBUG::2014-06-04 11:16:50,487::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-06-04 11:16:50,488::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-109::DEBUG::2014-06-04 11:16:50,488::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-109::WARNING::2014-06-04 11:16:50,489::fileUtils::167::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050 already exists >Thread-109::DEBUG::2014-06-04 11:16:50,489::blockSD::1091::Storage.StorageDomain::(createImageLinks) img run vol already exists: /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >Thread-109::DEBUG::2014-06-04 11:16:50,489::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-109::DEBUG::2014-06-04 11:16:50,490::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-109::DEBUG::2014-06-04 11:16:50,608::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-06-04 11:16:50,616::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-109::DEBUG::2014-06-04 11:16:50,630::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-109::INFO::2014-06-04 11:16:50,632::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, 'path': '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imgVolumesInfo': [{'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}]} >Thread-109::DEBUG::2014-06-04 11:16:50,632::task::1185::TaskManager.Task::(prepare) Task=`01596128-2452-4579-b9b5-88ad8a2279ca`::finished: {'info': {'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, 'path': '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'imgVolumesInfo': [{'domainID': '831ef374-8947-47f2-938f-5ec938f4fcef', 'volType': 'path', 'leaseOffset': 111149056, 'path': '/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/images/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'volumeID': 'ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'leasePath': '/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}]} >Thread-109::DEBUG::2014-06-04 11:16:50,632::task::595::TaskManager.Task::(_updateState) Task=`01596128-2452-4579-b9b5-88ad8a2279ca`::moving from state preparing -> state finished >Thread-109::DEBUG::2014-06-04 11:16:50,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-109::DEBUG::2014-06-04 11:16:50,632::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2014-06-04 11:16:50,633::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-109::DEBUG::2014-06-04 11:16:50,633::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-109::DEBUG::2014-06-04 11:16:50,633::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-109::DEBUG::2014-06-04 11:16:50,633::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-109::DEBUG::2014-06-04 11:16:50,633::task::990::TaskManager.Task::(_decref) Task=`01596128-2452-4579-b9b5-88ad8a2279ca`::ref 0 aborting False >Thread-109::INFO::2014-06-04 11:16:50,634::clientIF::324::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >Thread-109::DEBUG::2014-06-04 11:16:50,648::utils::642::root::(execCmd) '/usr/libexec/vdsm/hooks/before_vm_start/50_hostedengine' (cwd None) >Thread-109::DEBUG::2014-06-04 11:16:50,697::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::INFO::2014-06-04 11:16:50,698::hooks::100::root::(_runHooksDir) >Thread-109::DEBUG::2014-06-04 11:16:50,699::vm::3136::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::<?xml version="1.0" encoding="utf-8"?><domain type="kvm"> > <name>HostedEngine</name> > <uuid>8adf82c9-1900-4fd9-8ba4-d73b55146b5b</uuid> > <memory>4194304</memory> > <currentMemory>4194304</currentMemory> > <vcpu current="2">2</vcpu> > <memtune> > <min_guarantee>0</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <graphics autoport="yes" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" type="vnc"/> > <console type="pty"> > <target port="0" type="virtio"/> > </console> > <memballoon model="none"/> > <controller model="virtio-scsi" type="scsi"/> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > <mac address="00:1a:4c:10:3f:11"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source dev="/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6"/> > <target bus="virtio" dev="vda"/> > <serial>43819d41-ad14-495b-8a53-0832945a6050</serial> > <boot order="1"/> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="raw"/> > </disk> > <lease> > <key>ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6</key> > <lockspace>831ef374-8947-47f2-938f-5ec938f4fcef</lockspace> > <target offset="111149056" path="/dev/831ef374-8947-47f2-938f-5ec938f4fcef/leases"/> > </lease> > </devices> > <os> > <type arch="x86_64" machine="pc">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">oVirt</entry> > <entry name="product">oVirt Node</entry> > <entry name="version">6-5.el6.centos.11.1</entry> > <entry name="serial">30303734-3536-5A43-3133-343330305658_a4:5d:36:11:e1:cc</entry> > <entry name="uuid">8adf82c9-1900-4fd9-8ba4-d73b55146b5b</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Conroe</model> > </cpu> ><on_poweroff>destroy</on_poweroff><on_reboot>destroy</on_reboot><on_crash>destroy</on_crash></domain> >Thread-112::DEBUG::2014-06-04 11:16:51,315::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-112::ERROR::2014-06-04 11:16:51,315::BindingXMLRPC::1086::vds::(wrapper) unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 1070, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/BindingXMLRPC.py", line 314, in vmSetTicket > return vm.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/API.py", line 611, in setTicket > return v.setTicket(password, ttl, existingConnAction, params) > File "/usr/share/vdsm/vm.py", line 4480, in setTicket > graphics = _domParseStr(self._dom.XMLDesc(0)).childNodes[0]. \ >AttributeError: 'NoneType' object has no attribute 'XMLDesc' >libvirtEventLoop::DEBUG::2014-06-04 11:16:51,599::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Started detail 0 opaque None >Thread-109::DEBUG::2014-06-04 11:16:51,611::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-109::DEBUG::2014-06-04 11:16:51,615::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-109::DEBUG::2014-06-04 11:16:51,615::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-109::DEBUG::2014-06-04 11:16:51,615::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7f5f4c06ef38>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'type': u'disk'} >Thread-109::DEBUG::2014-06-04 11:16:51,615::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f5f4c06ef38>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', u'disk')} >Thread-109::DEBUG::2014-06-04 11:16:51,615::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7f5f4c06ef38>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', 'disk')} >Thread-109::DEBUG::2014-06-04 11:16:51,644::sampling::285::vm.Vm::(start) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start statistics collection >Thread-113::DEBUG::2014-06-04 11:16:51,648::sampling::314::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread started >Thread-113::DEBUG::2014-06-04 11:16:51,648::task::595::TaskManager.Task::(_updateState) Task=`e597d2db-0ff9-4310-a66a-714423463e2e`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:16:51,649::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:16:51,650::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:16:51,650::task::1185::TaskManager.Task::(prepare) Task=`e597d2db-0ff9-4310-a66a-714423463e2e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:16:51,650::task::595::TaskManager.Task::(_updateState) Task=`e597d2db-0ff9-4310-a66a-714423463e2e`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:16:51,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:16:51,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:16:51,650::task::990::TaskManager.Task::(_decref) Task=`e597d2db-0ff9-4310-a66a-714423463e2e`::ref 0 aborting False >Thread-109::DEBUG::2014-06-04 11:16:51,658::vmChannels::194::vds::(register) Add fileno 16 to listener's channels. >Thread-109::WARNING::2014-06-04 11:16:51,660::vm::3661::vm.Vm::(_readPauseCode) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_readPauseCode unsupported by libvirt vm >Thread-109::DEBUG::2014-06-04 11:16:51,699::vm::2263::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations released >VM Channels Listener::DEBUG::2014-06-04 11:16:52,017::vmChannels::102::vds::(_do_add_channels) fileno 16 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-06-04 11:16:52,017::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 16. >VM Channels Listener::DEBUG::2014-06-04 11:16:52,017::guestIF::147::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Attempting connection to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:16:52,019::guestIF::150::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Connected to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:16:52,019::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 16 succeeded. >Thread-114::DEBUG::2014-06-04 11:16:52,464::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmSetTicket with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b', '1368bkac', '10800', 'disconnect', {}) {} >Thread-114::DEBUG::2014-06-04 11:16:52,499::BindingXMLRPC::1074::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-115::DEBUG::2014-06-04 11:16:52,573::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-115::DEBUG::2014-06-04 11:16:52,573::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-115::DEBUG::2014-06-04 11:16:52,574::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-115::DEBUG::2014-06-04 11:16:52,574::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-115::DEBUG::2014-06-04 11:16:52,574::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-115::DEBUG::2014-06-04 11:16:52,574::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-115::DEBUG::2014-06-04 11:16:52,574::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-115::DEBUG::2014-06-04 11:16:52,574::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-7957399271026106538', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.93', 'elapsedTime': '2', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,237::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,237::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,237::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,237::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,238::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,238::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,238::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,238::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,238::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,238::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,239::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:16:56,239::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:17:00,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:00,410::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0938671 s, 43.6 kB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,244::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,244::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,244::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,245::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,245::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,245::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,245::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,245::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,245::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,246::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,246::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:01,246::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,251::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,251::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,251::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,252::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:06,253::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:17:10,412::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:17:10,413::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:17:10,416::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:10,468::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0473948 s, 43.2 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:17:10,469::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0473948 s, 43.2 kB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:17:10,469::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:17:10,469::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:17:10,469::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:17:10,470::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:17:10,470::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:17:10,470::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:17:10,471::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:17:10,471::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:17:10,472::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:10,609::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:17:10,610::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:17:10,611::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:17:10,612::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:17:10,612::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:17:10,612::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:17:10,613::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:10,724::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:17:10,727::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:10,734::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000954436 s, 4.3 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,258::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,259::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,299::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,299::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,300::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,300::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,300::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:11,300::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,306::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,306::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,358::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,358::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,359::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,359::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,359::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:16,359::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:17:20,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:20,799::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0530795 s, 77.2 kB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,365::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,365::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,390::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,391::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,391::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,391::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,391::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:21,392::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-06-04 11:17:22,051::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,397::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,397::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,428::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,429::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,429::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,429::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,429::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:26,429::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:17:30,803::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:30,825::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0160394 s, 255 kB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,435::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,437::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,437::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,437::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,438::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,438::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,438::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:31,438::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,444::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,444::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,465::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,465::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,466::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,466::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,466::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:36,466::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-77::DEBUG::2014-06-04 11:17:40,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:40,838::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109799 s, 3.7 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,472::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,472::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,490::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,490::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,491::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,491::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,491::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:41,491::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,497::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,498::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,507::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,507::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,507::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,508::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,508::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:46,508::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >libvirtEventLoop::DEBUG::2014-06-04 11:17:50,823::clientIF::555::vm.Vm::(dispatchLibvirtEvents) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::graphics event phase 0 localAddr {'node': '0.0.0.0', 'service': '5900', 'family': 0} remoteAddr {'node': '10.34.131.221', 'service': '58121', 'family': 0}authScheme vnc subject [] >Thread-77::DEBUG::2014-06-04 11:17:50,843::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:17:50,851::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107061 s, 3.8 MB/s\n'; <rc> = 0 >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,514::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,514::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,536::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,536::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,536::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,537::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,537::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:17:51,537::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-113::DEBUG::2014-06-04 11:17:51,746::task::595::TaskManager.Task::(_updateState) Task=`bf648d80-cbd2-4977-b22b-281292149dba`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:17:51,746::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:17:51,747::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:17:51,747::task::1185::TaskManager.Task::(prepare) Task=`bf648d80-cbd2-4977-b22b-281292149dba`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:17:51,747::task::595::TaskManager.Task::(_updateState) Task=`bf648d80-cbd2-4977-b22b-281292149dba`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:17:51,747::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:17:51,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:17:51,747::task::990::TaskManager.Task::(_decref) Task=`bf648d80-cbd2-4977-b22b-281292149dba`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:17:52,084::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >libvirtEventLoop::DEBUG::2014-06-04 11:17:58,892::clientIF::555::vm.Vm::(dispatchLibvirtEvents) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::graphics event phase 1 localAddr {'node': '0.0.0.0', 'service': '5900', 'family': 0} remoteAddr {'node': '10.34.131.221', 'service': '58121', 'family': 0}authScheme vnc subject [] >Thread-77::DEBUG::2014-06-04 11:18:00,856::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:18:00,864::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100502 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:18:10,870::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:18:10,876::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000962621 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:18:20,882::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:18:20,889::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999693 s, 4.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:18:22,116::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:18:30,894::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:18:30,901::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105021 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:18:40,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:18:40,914::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112066 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:18:50,920::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:18:50,927::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108148 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:18:51,789::task::595::TaskManager.Task::(_updateState) Task=`e3b296ae-862c-45ed-8000-6886b8938c28`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:18:51,789::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:18:51,790::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:18:51,790::task::1185::TaskManager.Task::(prepare) Task=`e3b296ae-862c-45ed-8000-6886b8938c28`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:18:51,790::task::595::TaskManager.Task::(_updateState) Task=`e3b296ae-862c-45ed-8000-6886b8938c28`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:18:51,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:18:51,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:18:51,790::task::990::TaskManager.Task::(_decref) Task=`e3b296ae-862c-45ed-8000-6886b8938c28`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:18:52,149::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:19:00,932::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:19:00,939::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114641 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:19:10,945::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:19:10,952::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102019 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:19:20,958::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:19:20,965::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107884 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:19:22,181::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:19:30,970::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:19:30,977::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115831 s, 3.5 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:19:40,983::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:19:40,990::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111241 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:19:50,996::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:19:51,003::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114029 s, 3.6 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:19:51,840::task::595::TaskManager.Task::(_updateState) Task=`b1e9a3cc-1c9d-457a-bb5c-ffb861c620b9`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:19:51,840::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:19:51,841::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:19:51,841::task::1185::TaskManager.Task::(prepare) Task=`b1e9a3cc-1c9d-457a-bb5c-ffb861c620b9`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:19:51,841::task::595::TaskManager.Task::(_updateState) Task=`b1e9a3cc-1c9d-457a-bb5c-ffb861c620b9`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:19:51,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:19:51,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:19:51,841::task::990::TaskManager.Task::(_decref) Task=`b1e9a3cc-1c9d-457a-bb5c-ffb861c620b9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:19:52,212::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:20:01,009::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:20:01,016::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011188 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:20:11,021::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:20:11,027::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000941837 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:20:21,032::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:20:21,134::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0954257 s, 42.9 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:20:22,245::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:20:31,140::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:20:31,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105839 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:20:41,153::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:20:41,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107642 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:20:51,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:20:51,173::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106381 s, 3.9 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:20:51,887::task::595::TaskManager.Task::(_updateState) Task=`8336a338-9376-4320-8dc1-317ebcbe1fde`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:20:51,888::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:20:51,888::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:20:51,889::task::1185::TaskManager.Task::(prepare) Task=`8336a338-9376-4320-8dc1-317ebcbe1fde`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:20:51,889::task::595::TaskManager.Task::(_updateState) Task=`8336a338-9376-4320-8dc1-317ebcbe1fde`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:20:51,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:20:51,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:20:51,889::task::990::TaskManager.Task::(_decref) Task=`8336a338-9376-4320-8dc1-317ebcbe1fde`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:20:52,278::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:21:01,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:21:01,186::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110445 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:21:11,191::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:21:11,199::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108234 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:21:21,205::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:21:21,212::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106988 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:21:22,310::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:21:31,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:21:31,224::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106422 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:21:41,230::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:21:41,237::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110235 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:21:51,243::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:21:51,250::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00125301 s, 3.3 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:21:51,929::task::595::TaskManager.Task::(_updateState) Task=`b6d56123-19e2-457e-9dd6-6219b71f52d0`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:21:51,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:21:51,930::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:21:51,930::task::1185::TaskManager.Task::(prepare) Task=`b6d56123-19e2-457e-9dd6-6219b71f52d0`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:21:51,930::task::595::TaskManager.Task::(_updateState) Task=`b6d56123-19e2-457e-9dd6-6219b71f52d0`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:21:51,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:21:51,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:21:51,930::task::990::TaskManager.Task::(_decref) Task=`b6d56123-19e2-457e-9dd6-6219b71f52d0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:21:52,351::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:22:01,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:01,263::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109742 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:11,266::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:22:11,267::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:22:11,270::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:11,275::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000838275 s, 2.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:11,275::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000838275 s, 2.4 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:22:11,276::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:22:11,276::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:22:11,276::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:22:11,276::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:22:11,277::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:22:11,277::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:22:11,277::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:22:11,277::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:22:11,278::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:11,399::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:11,400::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:22:11,400::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:22:11,401::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:22:11,402::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:22:11,402::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:22:11,402::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:11,516::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:11,520::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:11,527::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100206 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:21,532::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:21,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112613 s, 3.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:22:22,384::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:22:31,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:31,552::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000949076 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:41,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:41,565::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105165 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:22:51,570::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:22:51,577::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001085 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:22:51,971::task::595::TaskManager.Task::(_updateState) Task=`f44d2406-add6-415c-bb4a-ffa2c614edae`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:22:51,971::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:22:51,971::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:22:51,971::task::1185::TaskManager.Task::(prepare) Task=`f44d2406-add6-415c-bb4a-ffa2c614edae`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:22:51,972::task::595::TaskManager.Task::(_updateState) Task=`f44d2406-add6-415c-bb4a-ffa2c614edae`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:22:51,972::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:22:51,972::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:22:51,972::task::990::TaskManager.Task::(_decref) Task=`f44d2406-add6-415c-bb4a-ffa2c614edae`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:22:52,416::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:23:01,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:23:01,590::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108292 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:23:11,596::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:23:11,603::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010987 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:23:21,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:23:21,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111256 s, 3.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:23:22,448::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:23:31,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:23:31,628::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106062 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:23:41,634::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:23:41,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106878 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:23:51,646::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:23:51,653::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011237 s, 3.6 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:23:52,012::task::595::TaskManager.Task::(_updateState) Task=`d60cb8ad-7825-4686-9ddc-b5643300f1f7`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:23:52,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:23:52,013::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:23:52,013::task::1185::TaskManager.Task::(prepare) Task=`d60cb8ad-7825-4686-9ddc-b5643300f1f7`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:23:52,013::task::595::TaskManager.Task::(_updateState) Task=`d60cb8ad-7825-4686-9ddc-b5643300f1f7`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:23:52,013::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:23:52,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:23:52,014::task::990::TaskManager.Task::(_decref) Task=`d60cb8ad-7825-4686-9ddc-b5643300f1f7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:23:52,481::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:24:01,659::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:24:01,666::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114563 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:24:11,672::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:24:11,679::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106106 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:24:21,684::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:24:21,691::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106361 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:24:22,514::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:24:31,697::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:24:31,704::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107901 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:24:41,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:24:41,716::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107764 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:24:51,723::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:24:51,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109987 s, 3.7 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:24:52,052::task::595::TaskManager.Task::(_updateState) Task=`3ae5b628-040f-48f6-9998-ab6a14aa6f9e`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:24:52,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:24:52,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:24:52,053::task::1185::TaskManager.Task::(prepare) Task=`3ae5b628-040f-48f6-9998-ab6a14aa6f9e`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:24:52,053::task::595::TaskManager.Task::(_updateState) Task=`3ae5b628-040f-48f6-9998-ab6a14aa6f9e`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:24:52,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:24:52,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:24:52,054::task::990::TaskManager.Task::(_decref) Task=`3ae5b628-040f-48f6-9998-ab6a14aa6f9e`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:24:52,546::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:25:01,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:25:01,744::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114727 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:25:11,755::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:25:11,763::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011401 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:25:21,769::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:25:21,781::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00126048 s, 3.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:25:22,578::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:25:31,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:25:31,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113807 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:25:41,798::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:25:41,806::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109039 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:25:51,811::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:25:51,818::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106158 s, 3.9 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:25:52,095::task::595::TaskManager.Task::(_updateState) Task=`44894f7e-c057-4358-ba60-ed5c1758c814`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:25:52,095::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:25:52,096::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:25:52,096::task::1185::TaskManager.Task::(prepare) Task=`44894f7e-c057-4358-ba60-ed5c1758c814`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:25:52,096::task::595::TaskManager.Task::(_updateState) Task=`44894f7e-c057-4358-ba60-ed5c1758c814`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:25:52,096::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:25:52,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:25:52,097::task::990::TaskManager.Task::(_decref) Task=`44894f7e-c057-4358-ba60-ed5c1758c814`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:25:52,611::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:26:01,823::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:26:01,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107486 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:26:11,836::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:26:11,843::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112095 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:26:21,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:26:21,856::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113432 s, 3.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:26:22,643::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:26:31,861::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:26:31,868::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105126 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:26:41,873::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:26:41,881::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105262 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:26:51,886::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:26:51,893::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108121 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:26:52,190::task::595::TaskManager.Task::(_updateState) Task=`92ce07c1-5d39-401f-bc43-254dc02582e7`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:26:52,191::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:26:52,192::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:26:52,193::task::1185::TaskManager.Task::(prepare) Task=`92ce07c1-5d39-401f-bc43-254dc02582e7`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:26:52,193::task::595::TaskManager.Task::(_updateState) Task=`92ce07c1-5d39-401f-bc43-254dc02582e7`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:26:52,193::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:26:52,193::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:26:52,193::task::990::TaskManager.Task::(_decref) Task=`92ce07c1-5d39-401f-bc43-254dc02582e7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:26:52,676::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:27:01,898::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:01,906::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104963 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:11,909::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:27:11,909::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:27:11,911::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:11,917::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000879796 s, 2.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:11,917::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000879796 s, 2.3 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:27:11,918::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:27:11,918::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:27:11,918::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:27:11,918::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:27:11,919::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:27:11,919::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:27:11,919::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:27:11,919::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:27:11,920::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:12,041::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:12,043::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:27:12,043::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:27:12,044::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:27:12,058::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:27:12,058::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:27:12,059::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:12,171::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:12,174::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:12,181::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000949163 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:22,186::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:22,193::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108066 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:27:22,709::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:27:32,199::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:32,206::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011026 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:42,212::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:42,219::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108597 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:27:52,224::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:27:52,232::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108618 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:27:52,282::task::595::TaskManager.Task::(_updateState) Task=`7aed8e3c-24f7-4da2-afc1-206e1125fc16`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:27:52,283::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:27:52,283::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:27:52,283::task::1185::TaskManager.Task::(prepare) Task=`7aed8e3c-24f7-4da2-afc1-206e1125fc16`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:27:52,283::task::595::TaskManager.Task::(_updateState) Task=`7aed8e3c-24f7-4da2-afc1-206e1125fc16`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:27:52,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:27:52,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:27:52,284::task::990::TaskManager.Task::(_decref) Task=`7aed8e3c-24f7-4da2-afc1-206e1125fc16`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:27:52,741::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:28:02,237::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:28:02,244::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109518 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:28:12,249::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:28:12,257::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107485 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:28:22,262::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:28:22,269::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00130255 s, 3.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:28:22,774::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:28:32,274::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:28:32,282::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110842 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:28:42,287::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:28:42,294::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000961258 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:28:52,299::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:28:52,306::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108013 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:28:52,377::task::595::TaskManager.Task::(_updateState) Task=`ec41c16e-2a0b-408e-9d15-bbe2ca93b433`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:28:52,377::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:28:52,377::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:28:52,377::task::1185::TaskManager.Task::(prepare) Task=`ec41c16e-2a0b-408e-9d15-bbe2ca93b433`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:28:52,378::task::595::TaskManager.Task::(_updateState) Task=`ec41c16e-2a0b-408e-9d15-bbe2ca93b433`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:28:52,378::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:28:52,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:28:52,378::task::990::TaskManager.Task::(_decref) Task=`ec41c16e-2a0b-408e-9d15-bbe2ca93b433`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:28:52,806::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:29:02,312::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:29:02,319::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113793 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:29:12,324::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:29:12,331::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109419 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:29:22,337::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:29:22,344::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00117014 s, 3.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:29:22,837::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:29:32,349::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:29:32,357::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111482 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:29:42,362::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:29:42,369::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00121991 s, 3.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:29:52,374::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:29:52,382::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000978558 s, 4.2 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:29:52,429::task::595::TaskManager.Task::(_updateState) Task=`214a974c-19ed-4244-9f47-c35b33eb7c6d`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:29:52,429::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:29:52,429::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:29:52,430::task::1185::TaskManager.Task::(prepare) Task=`214a974c-19ed-4244-9f47-c35b33eb7c6d`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:29:52,430::task::595::TaskManager.Task::(_updateState) Task=`214a974c-19ed-4244-9f47-c35b33eb7c6d`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:29:52,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:29:52,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:29:52,430::task::990::TaskManager.Task::(_decref) Task=`214a974c-19ed-4244-9f47-c35b33eb7c6d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:29:52,867::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:30:02,387::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:30:02,394::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101993 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:30:12,399::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:30:12,407::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104619 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:30:22,412::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:30:22,419::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000971371 s, 4.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:30:22,898::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:30:32,424::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:30:32,431::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000978375 s, 4.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:30:42,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:30:42,444::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990984 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:30:52,449::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:30:52,456::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098308 s, 4.2 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:30:52,506::task::595::TaskManager.Task::(_updateState) Task=`924db1ce-1b0a-4f76-a58e-b400a673a6ea`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:30:52,506::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:30:52,506::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:30:52,507::task::1185::TaskManager.Task::(prepare) Task=`924db1ce-1b0a-4f76-a58e-b400a673a6ea`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:30:52,507::task::595::TaskManager.Task::(_updateState) Task=`924db1ce-1b0a-4f76-a58e-b400a673a6ea`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:30:52,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:30:52,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:30:52,507::task::990::TaskManager.Task::(_decref) Task=`924db1ce-1b0a-4f76-a58e-b400a673a6ea`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:30:52,928::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:31:02,461::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:31:02,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001107 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:31:12,474::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:31:12,481::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00096313 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:31:22,487::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:31:22,494::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000957031 s, 4.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:31:22,959::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:31:32,499::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:31:32,506::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011212 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:31:42,512::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:31:42,519::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993107 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:31:52,524::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:31:52,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106343 s, 3.9 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:31:52,606::task::595::TaskManager.Task::(_updateState) Task=`7fc2f0e1-cdf6-41c5-a34c-aad57d90aa39`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:31:52,607::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:31:52,607::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:31:52,607::task::1185::TaskManager.Task::(prepare) Task=`7fc2f0e1-cdf6-41c5-a34c-aad57d90aa39`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:31:52,607::task::595::TaskManager.Task::(_updateState) Task=`7fc2f0e1-cdf6-41c5-a34c-aad57d90aa39`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:31:52,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:31:52,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:31:52,608::task::990::TaskManager.Task::(_decref) Task=`7fc2f0e1-cdf6-41c5-a34c-aad57d90aa39`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:31:53,001::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:32:02,536::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:02,544::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108127 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:32:12,547::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:32:12,547::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:32:12,549::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:12,555::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000881165 s, 2.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:32:12,555::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000881165 s, 2.3 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:32:12,555::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:32:12,556::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:32:12,556::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:32:12,556::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:32:12,556::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:32:12,557::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:32:12,557::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:32:12,557::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:32:12,558::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:12,679::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:32:12,681::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:32:12,681::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:32:12,682::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:32:12,682::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:32:12,682::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:32:12,683::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:12,797::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:32:12,800::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:12,808::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099113 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:32:22,813::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:22,820::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109558 s, 3.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:32:23,034::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:32:32,825::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:32,832::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011054 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:32:42,837::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:42,845::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112876 s, 3.6 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:32:52,684::task::595::TaskManager.Task::(_updateState) Task=`6e6cabab-d4ec-4c45-983e-66c79fa2468b`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:32:52,684::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:32:52,684::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:32:52,685::task::1185::TaskManager.Task::(prepare) Task=`6e6cabab-d4ec-4c45-983e-66c79fa2468b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:32:52,685::task::595::TaskManager.Task::(_updateState) Task=`6e6cabab-d4ec-4c45-983e-66c79fa2468b`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:32:52,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:32:52,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:32:52,685::task::990::TaskManager.Task::(_decref) Task=`6e6cabab-d4ec-4c45-983e-66c79fa2468b`::ref 0 aborting False >Thread-77::DEBUG::2014-06-04 11:32:52,850::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:32:52,857::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107504 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:32:53,066::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:33:02,862::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:33:02,869::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106114 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:33:12,874::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:33:12,882::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108606 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:33:22,887::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:33:22,894::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105738 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:33:23,099::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:33:32,899::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:33:32,906::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107975 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:33:42,911::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:33:42,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106602 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:33:52,724::task::595::TaskManager.Task::(_updateState) Task=`2c3c8ca4-4587-4b0b-bf6c-e216799b1c64`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:33:52,725::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:33:52,725::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:33:52,725::task::1185::TaskManager.Task::(prepare) Task=`2c3c8ca4-4587-4b0b-bf6c-e216799b1c64`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:33:52,725::task::595::TaskManager.Task::(_updateState) Task=`2c3c8ca4-4587-4b0b-bf6c-e216799b1c64`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:33:52,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:33:52,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:33:52,726::task::990::TaskManager.Task::(_decref) Task=`2c3c8ca4-4587-4b0b-bf6c-e216799b1c64`::ref 0 aborting False >Thread-77::DEBUG::2014-06-04 11:33:52,924::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:33:52,931::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010627 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:33:53,132::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:34:02,936::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:34:02,943::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109438 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:34:12,948::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:34:12,956::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107387 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:34:22,961::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:34:22,968::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107925 s, 3.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:34:23,165::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:34:32,973::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:34:32,980::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107632 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:34:42,986::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:34:42,993::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107469 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:34:52,766::task::595::TaskManager.Task::(_updateState) Task=`01bbf970-3220-4b8e-9c91-a8a8c86e9391`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:34:52,766::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:34:52,767::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:34:52,767::task::1185::TaskManager.Task::(prepare) Task=`01bbf970-3220-4b8e-9c91-a8a8c86e9391`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:34:52,767::task::595::TaskManager.Task::(_updateState) Task=`01bbf970-3220-4b8e-9c91-a8a8c86e9391`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:34:52,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:34:52,767::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:34:52,767::task::990::TaskManager.Task::(_decref) Task=`01bbf970-3220-4b8e-9c91-a8a8c86e9391`::ref 0 aborting False >Thread-77::DEBUG::2014-06-04 11:34:52,998::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:34:53,005::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101865 s, 4.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:34:53,198::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:35:03,010::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:35:03,017::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105847 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:35:13,023::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:35:13,030::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101988 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:35:23,035::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:35:23,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105024 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:35:23,231::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:35:33,047::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:35:33,054::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108595 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:35:43,060::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:35:43,067::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105582 s, 3.9 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:35:52,807::task::595::TaskManager.Task::(_updateState) Task=`bcec361a-14b6-41e9-abb5-e3eb8223a92b`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:35:52,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:35:52,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:35:52,808::task::1185::TaskManager.Task::(prepare) Task=`bcec361a-14b6-41e9-abb5-e3eb8223a92b`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:35:52,808::task::595::TaskManager.Task::(_updateState) Task=`bcec361a-14b6-41e9-abb5-e3eb8223a92b`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:35:52,809::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:35:52,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:35:52,809::task::990::TaskManager.Task::(_decref) Task=`bcec361a-14b6-41e9-abb5-e3eb8223a92b`::ref 0 aborting False >Thread-77::DEBUG::2014-06-04 11:35:53,072::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:35:53,079::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103323 s, 4.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:35:53,264::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:36:03,084::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:36:03,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108754 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:36:13,096::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:36:13,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108615 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:36:23,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:36:23,116::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103829 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:36:23,298::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:36:33,121::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:36:33,128::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112675 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:36:43,134::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:36:43,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107146 s, 3.8 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:36:52,849::task::595::TaskManager.Task::(_updateState) Task=`23c3e8ea-cc02-4665-894c-b10387c2c4d6`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:36:52,850::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:36:52,850::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:36:52,850::task::1185::TaskManager.Task::(prepare) Task=`23c3e8ea-cc02-4665-894c-b10387c2c4d6`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:36:52,850::task::595::TaskManager.Task::(_updateState) Task=`23c3e8ea-cc02-4665-894c-b10387c2c4d6`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:36:52,851::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:36:52,851::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:36:52,851::task::990::TaskManager.Task::(_decref) Task=`23c3e8ea-cc02-4665-894c-b10387c2c4d6`::ref 0 aborting False >Thread-77::DEBUG::2014-06-04 11:36:53,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:36:53,154::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109566 s, 3.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:36:53,329::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:37:03,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:03,167::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000951897 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:37:13,169::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:37:13,169::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:37:13,171::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:13,176::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0007703 s, 2.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:37:13,176::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0007703 s, 2.7 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:37:13,176::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:37:13,176::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:37:13,177::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:37:13,177::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:37:13,177::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:37:13,177::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:37:13,177::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:37:13,178::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:37:13,178::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:13,290::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:37:13,292::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:37:13,292::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:37:13,293::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:37:13,293::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:37:13,293::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:37:13,294::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:13,406::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:37:13,408::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:13,477::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0628819 s, 65.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:37:23,362::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:37:23,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:23,490::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0018401 s, 2.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:37:33,495::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:33,503::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000986837 s, 4.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:37:43,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:43,519::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00486409 s, 842 kB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:37:52,891::task::595::TaskManager.Task::(_updateState) Task=`5beb7793-1b0c-4480-a999-36223f466b9f`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:37:52,892::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:37:52,892::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:37:52,892::task::1185::TaskManager.Task::(prepare) Task=`5beb7793-1b0c-4480-a999-36223f466b9f`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:37:52,892::task::595::TaskManager.Task::(_updateState) Task=`5beb7793-1b0c-4480-a999-36223f466b9f`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:37:52,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:37:52,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:37:52,893::task::990::TaskManager.Task::(_decref) Task=`5beb7793-1b0c-4480-a999-36223f466b9f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:37:53,396::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:37:53,524::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:37:53,541::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0107031 s, 383 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:38:03,546::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:38:03,552::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000942216 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:38:13,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:38:13,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00090745 s, 4.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:38:23,426::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:38:23,568::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:38:23,574::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000954619 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:38:33,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:38:33,584::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000969671 s, 4.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:38:43,593::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:38:43,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993192 s, 4.1 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:38:52,946::task::595::TaskManager.Task::(_updateState) Task=`22a751b1-b4d5-461b-a466-1618bec9112f`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:38:52,947::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:38:52,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:38:52,948::task::1185::TaskManager.Task::(prepare) Task=`22a751b1-b4d5-461b-a466-1618bec9112f`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:38:52,948::task::595::TaskManager.Task::(_updateState) Task=`22a751b1-b4d5-461b-a466-1618bec9112f`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:38:52,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:38:52,948::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:38:52,949::task::990::TaskManager.Task::(_decref) Task=`22a751b1-b4d5-461b-a466-1618bec9112f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:38:53,458::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:38:53,603::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:38:54,288::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.678402 s, 6.0 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:39:04,293::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:39:04,301::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00170083 s, 2.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:39:14,307::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:39:14,423::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.110682 s, 37.0 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:39:23,490::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:39:24,426::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:39:24,432::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000953839 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:39:34,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:39:34,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101648 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:39:44,445::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:39:44,451::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000918867 s, 4.5 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:39:52,995::task::595::TaskManager.Task::(_updateState) Task=`260cc0db-b693-4532-b3a2-d895a7566287`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:39:52,995::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:39:52,995::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:39:52,996::task::1185::TaskManager.Task::(prepare) Task=`260cc0db-b693-4532-b3a2-d895a7566287`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:39:52,996::task::595::TaskManager.Task::(_updateState) Task=`260cc0db-b693-4532-b3a2-d895a7566287`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:39:52,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:39:52,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:39:52,996::task::990::TaskManager.Task::(_decref) Task=`260cc0db-b693-4532-b3a2-d895a7566287`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:39:53,522::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:39:54,455::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:39:54,460::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000957162 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:40:04,465::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:40:04,966::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.495015 s, 8.3 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:40:14,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:40:15,326::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.347044 s, 11.8 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:40:23,554::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:40:25,331::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:40:26,290::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.953607 s, 4.3 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:40:36,293::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:40:36,299::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103899 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:40:46,304::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:40:46,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000971451 s, 4.2 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:40:53,053::task::595::TaskManager.Task::(_updateState) Task=`86438fd5-dfed-4b24-b9f9-cb78a1237332`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:40:53,053::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:40:53,053::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:40:53,054::task::1185::TaskManager.Task::(prepare) Task=`86438fd5-dfed-4b24-b9f9-cb78a1237332`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:40:53,054::task::595::TaskManager.Task::(_updateState) Task=`86438fd5-dfed-4b24-b9f9-cb78a1237332`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:40:53,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:40:53,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:40:53,054::task::990::TaskManager.Task::(_decref) Task=`86438fd5-dfed-4b24-b9f9-cb78a1237332`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:40:53,588::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:40:56,316::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:40:56,323::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000995358 s, 4.1 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:41:06,328::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:41:06,335::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106685 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:41:16,341::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:41:16,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112572 s, 3.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:41:23,620::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:41:26,353::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:41:26,360::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104552 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:41:36,366::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:41:36,373::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111775 s, 3.7 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:41:46,378::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:41:46,385::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101938 s, 4.0 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:41:53,094::task::595::TaskManager.Task::(_updateState) Task=`651730f0-19f9-44e5-9dda-fe5078d858eb`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:41:53,094::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:41:53,095::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:41:53,095::task::1185::TaskManager.Task::(prepare) Task=`651730f0-19f9-44e5-9dda-fe5078d858eb`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:41:53,095::task::595::TaskManager.Task::(_updateState) Task=`651730f0-19f9-44e5-9dda-fe5078d858eb`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:41:53,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:41:53,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:41:53,095::task::990::TaskManager.Task::(_decref) Task=`651730f0-19f9-44e5-9dda-fe5078d858eb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:41:53,653::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:41:56,390::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:41:56,397::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112534 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:06,403::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:06,410::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103915 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:16,413::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:42:16,413::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:42:16,415::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:16,421::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000906818 s, 2.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:16,421::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000906818 s, 2.3 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:42:16,422::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:42:16,422::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:42:16,422::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:42:16,422::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:42:16,423::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:42:16,423::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:42:16,423::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:42:16,423::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:42:16,424::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:16,576::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:16,577::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:42:16,578::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:42:16,579::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:42:16,579::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:42:16,579::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:42:16,579::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:16,703::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:16,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:16,712::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979057 s, 4.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:42:23,686::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:42:26,717::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:26,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103657 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:36,729::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:36,736::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101412 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:42:46,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:46,748::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104936 s, 3.9 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:42:53,136::task::595::TaskManager.Task::(_updateState) Task=`b6ce43ce-bdbd-4afa-8669-157de939f63a`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:42:53,136::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:42:53,137::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:42:53,138::task::1185::TaskManager.Task::(prepare) Task=`b6ce43ce-bdbd-4afa-8669-157de939f63a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:42:53,138::task::595::TaskManager.Task::(_updateState) Task=`b6ce43ce-bdbd-4afa-8669-157de939f63a`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:42:53,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:42:53,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:42:53,138::task::990::TaskManager.Task::(_decref) Task=`b6ce43ce-bdbd-4afa-8669-157de939f63a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:42:53,719::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:42:56,754::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:42:56,761::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010667 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:43:06,766::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:43:06,773::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105799 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:43:16,778::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:43:16,785::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105723 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:43:23,751::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:43:26,791::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:43:26,798::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000958049 s, 4.3 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:43:36,803::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:43:36,815::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00567466 s, 722 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:43:46,820::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:43:46,827::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011161 s, 3.7 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:43:53,183::task::595::TaskManager.Task::(_updateState) Task=`4ad19a53-dd2b-42d2-9f74-71f0e82cee0a`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:43:53,184::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:43:53,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:43:53,184::task::1185::TaskManager.Task::(prepare) Task=`4ad19a53-dd2b-42d2-9f74-71f0e82cee0a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:43:53,184::task::595::TaskManager.Task::(_updateState) Task=`4ad19a53-dd2b-42d2-9f74-71f0e82cee0a`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:43:53,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:43:53,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:43:53,185::task::990::TaskManager.Task::(_decref) Task=`4ad19a53-dd2b-42d2-9f74-71f0e82cee0a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:43:53,785::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:43:56,833::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:43:56,840::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108638 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:44:06,845::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:44:06,852::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010506 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:44:16,857::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:44:16,864::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105548 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:44:23,818::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:44:26,870::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:44:26,877::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108322 s, 3.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:44:36,882::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:44:36,889::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114365 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:44:46,895::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:44:46,902::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110244 s, 3.7 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:44:53,226::task::595::TaskManager.Task::(_updateState) Task=`72c77599-dfb2-4d0c-b1ec-3a131c3af44a`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:44:53,227::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:44:53,227::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:44:53,227::task::1185::TaskManager.Task::(prepare) Task=`72c77599-dfb2-4d0c-b1ec-3a131c3af44a`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:44:53,228::task::595::TaskManager.Task::(_updateState) Task=`72c77599-dfb2-4d0c-b1ec-3a131c3af44a`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:44:53,228::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:44:53,228::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:44:53,228::task::990::TaskManager.Task::(_decref) Task=`72c77599-dfb2-4d0c-b1ec-3a131c3af44a`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:44:53,850::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:44:56,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:44:56,914::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102738 s, 4.0 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:45:06,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:45:06,926::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112339 s, 3.6 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:45:16,931::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:45:16,937::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000965769 s, 4.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:45:23,882::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:45:26,941::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:45:26,955::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00797833 s, 513 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:45:36,960::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:45:36,965::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000931193 s, 4.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:45:46,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:45:46,974::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106119 s, 3.9 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:45:53,269::task::595::TaskManager.Task::(_updateState) Task=`931702ee-b2d5-4bc0-a118-f28779cb066f`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:45:53,270::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:45:53,270::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:45:53,270::task::1185::TaskManager.Task::(prepare) Task=`931702ee-b2d5-4bc0-a118-f28779cb066f`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:45:53,270::task::595::TaskManager.Task::(_updateState) Task=`931702ee-b2d5-4bc0-a118-f28779cb066f`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:45:53,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:45:53,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:45:53,271::task::990::TaskManager.Task::(_decref) Task=`931702ee-b2d5-4bc0-a118-f28779cb066f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:45:53,915::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:45:56,978::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:45:56,984::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010449 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:46:06,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:46:06,995::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000934364 s, 4.4 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:46:17,001::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:46:17,086::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0786701 s, 52.1 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:46:23,947::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:46:27,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:46:27,106::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00873382 s, 469 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:46:37,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:46:37,120::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00232244 s, 1.8 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:46:47,125::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:46:47,133::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000936676 s, 4.4 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:46:53,306::task::595::TaskManager.Task::(_updateState) Task=`60ba78c9-cca0-4753-a7ee-86ee94e25532`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:46:53,306::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:46:53,306::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:46:53,306::task::1185::TaskManager.Task::(prepare) Task=`60ba78c9-cca0-4753-a7ee-86ee94e25532`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:46:53,307::task::595::TaskManager.Task::(_updateState) Task=`60ba78c9-cca0-4753-a7ee-86ee94e25532`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:46:53,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:46:53,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:46:53,307::task::990::TaskManager.Task::(_decref) Task=`60ba78c9-cca0-4753-a7ee-86ee94e25532`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:46:53,979::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:46:57,139::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:46:57,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0130414 s, 314 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:07,162::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:07,180::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0122617 s, 334 kB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:17,183::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:47:17,184::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:47:17,185::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:17,190::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000833441 s, 2.5 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:17,190::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000833441 s, 2.5 MB/s'], size: 2048 >Thread-77::DEBUG::2014-06-04 11:47:17,190::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-77::WARNING::2014-06-04 11:47:17,190::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-77::DEBUG::2014-06-04 11:47:17,190::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-77::DEBUG::2014-06-04 11:47:17,191::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:47:17,191::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:47:17,191::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:47:17,191::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:47:17,191::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-77::DEBUG::2014-06-04 11:47:17,192::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:17,300::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:17,302::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-77::DEBUG::2014-06-04 11:47:17,302::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-77::INFO::2014-06-04 11:47:17,303::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-77::INFO::2014-06-04 11:47:17,303::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-77::INFO::2014-06-04 11:47:17,303::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-77::DEBUG::2014-06-04 11:47:17,304::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:17,415::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:17,417::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:17,422::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000905221 s, 4.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:47:24,012::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:47:27,426::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:27,432::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104631 s, 3.9 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:37,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:37,444::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000968093 s, 4.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:47:47,449::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:47,457::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011474 s, 3.6 MB/s\n'; <rc> = 0 >Thread-113::DEBUG::2014-06-04 11:47:53,354::task::595::TaskManager.Task::(_updateState) Task=`55c1771e-12a4-4204-8010-0f6d0078a759`::moving from state init -> state preparing >Thread-113::INFO::2014-06-04 11:47:53,355::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-113::INFO::2014-06-04 11:47:53,355::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:47:53,355::task::1185::TaskManager.Task::(prepare) Task=`55c1771e-12a4-4204-8010-0f6d0078a759`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-113::DEBUG::2014-06-04 11:47:53,355::task::595::TaskManager.Task::(_updateState) Task=`55c1771e-12a4-4204-8010-0f6d0078a759`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-06-04 11:47:53,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-06-04 11:47:53,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-06-04 11:47:53,356::task::990::TaskManager.Task::(_decref) Task=`55c1771e-12a4-4204-8010-0f6d0078a759`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-06-04 11:47:54,046::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:47:57,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:47:57,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00128869 s, 3.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:48:07,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:48:07,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000973164 s, 4.2 MB/s\n'; <rc> = 0 >Thread-77::DEBUG::2014-06-04 11:48:17,522::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:48:17,527::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104878 s, 3.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-06-04 11:48:24,078::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 16. >Thread-77::DEBUG::2014-06-04 11:48:27,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-77::DEBUG::2014-06-04 11:48:27,537::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106134 s, 3.9 MB/s\n'; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:48:31,712::vdsm::55::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-06-04 11:48:32,575::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-06-04 11:48:32,575::momIF::84::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-06-04 11:48:32,576::task::595::TaskManager.Task::(_updateState) Task=`ae27106b-100a-4cea-916c-dfcac32e74b7`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:48:32,576::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-06-04 11:48:32,577::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::DEBUG::2014-06-04 11:48:32,579::sp::380::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master` is not mounted, skipping >MainThread::INFO::2014-06-04 11:48:32,895::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::INFO::2014-06-04 11:48:32,895::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::DEBUG::2014-06-04 11:48:32,895::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-77::INFO::2014-06-04 11:48:32,895::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 831ef374-8947-47f2-938f-5ec938f4fcef (id: 1) >Thread-77::DEBUG::2014-06-04 11:48:32,896::domainMonitor::184::Storage.DomainMonitorThread::(_monitorLoop) Unable to release the host id 1 for domain 831ef374-8947-47f2-938f-5ec938f4fcef >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 181, in _monitorLoop > self.domain.releaseHostId(self.hostId, unused=True) > File "/usr/share/vdsm/storage/sd.py", line 461, in releaseHostId > self._clusterLock.releaseHostId(hostId, async, unused) > File "/usr/share/vdsm/storage/clusterlock.py", line 214, in releaseHostId > raise se.ReleaseHostIdFailure(self._sdUUID, e) >ReleaseHostIdFailure: Cannot release host id: ('831ef374-8947-47f2-938f-5ec938f4fcef', SanlockException(16, 'Sanlock lockspace remove failure', 'Device or resource busy')) >MainThread::DEBUG::2014-06-04 11:48:32,897::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-06-04 11:48:32,897::taskManager::86::TaskManager::(prepareForShutdown) 58918f9e-ff1c-46ba-9e44-7ac4272981b0 >MainThread::INFO::2014-06-04 11:48:32,897::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-06-04 11:48:32,897::task::1185::TaskManager.Task::(prepare) Task=`ae27106b-100a-4cea-916c-dfcac32e74b7`::finished: None >MainThread::DEBUG::2014-06-04 11:48:32,897::task::595::TaskManager.Task::(_updateState) Task=`ae27106b-100a-4cea-916c-dfcac32e74b7`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:48:32,897::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:48:32,898::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:48:32,898::task::990::TaskManager.Task::(_decref) Task=`ae27106b-100a-4cea-916c-dfcac32e74b7`::ref 0 aborting False >MainThread::INFO::2014-06-04 11:48:32,898::vdsm::125::vds::(run) VDSM main thread ended. Waiting for 19 other threads... >MainThread::INFO::2014-06-04 11:48:32,898::vdsm::129::vds::(run) <_MainThread(MainThread, started 140048683046656)> >MainThread::INFO::2014-06-04 11:48:32,898::vdsm::129::vds::(run) <Thread(libvirtEventLoop, started daemon 140048416978688)> >MainThread::INFO::2014-06-04 11:48:32,898::vdsm::129::vds::(run) <WorkerThread(58918f9e-ff1c-46ba-9e44-7ac4272981b0, started daemon 140048280319744)> >MainThread::INFO::2014-06-04 11:48:32,898::vdsm::129::vds::(run) <GuestMonitor(GuestMonitor-HostedEngine, started daemon 140047026026240)> >MainThread::INFO::2014-06-04 11:48:32,898::vdsm::129::vds::(run) <WorkerThread(fd7279eb-b4f8-4138-ab44-00342644f214, started daemon 140048406488832)> >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <GuestManager(GuestManager, started daemon 140047049123584)> >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <HostMonitor(HostMonitor, started daemon 140047059613440)> >MainThread::INFO::2014-06-04 11:48:32,899::vmChannels::183::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <Listener(VM Channels Listener, started daemon 140047500162816)> >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <WorkerThread(Thread-9, started daemon 140048248850176)> >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <WorkerThread(Thread-8, started daemon 140048259340032)> >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <WorkerThread(Thread-7, started daemon 140048269829888)> >MainThread::DEBUG::2014-06-04 11:48:32,899::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <VmStatsThread(Thread-113, started daemon 140047542122240)> >Thread-113::DEBUG::2014-06-04 11:48:32,899::sampling::323::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread finished >MainThread::INFO::2014-06-04 11:48:32,899::vdsm::129::vds::(run) <WorkerThread(Thread-10, started daemon 140048238360320)> >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140047510652672)> >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <_DummyThread(Dummy-45, started daemon 140046225094400)> >MainThread::INFO::2014-06-04 11:48:32,900::momIF::84::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <MomThread(MOM, started 140047521142528)> >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <WorkerThread(Thread-6, started daemon 140048364529408)> >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <WorkerThread(Thread-5, started daemon 140048375019264)> >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <WorkerThread(c62531e8-f925-414c-ab7f-5ab618ca0890, started daemon 140048385509120)> >MainThread::INFO::2014-06-04 11:48:32,900::vdsm::129::vds::(run) <WorkerThread(f1f3b430-958e-473a-b3e4-4c89e6db46a1, started daemon 140048395998976)> >VM Channels Listener::INFO::2014-06-04 11:48:33,087::vmChannels::178::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-06-04 11:48:53,108::vdsm::119::vds::(run) (PID: 64663) I am the actual vdsm 4.14.6-0.el6 localhost.localdomain (2.6.32-431.el6.x86_64) >MainThread::DEBUG::2014-06-04 11:48:53,108::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-06-04 11:48:53,108::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2014-06-04 11:48:53,110::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-06-04 11:48:53,113::sp::380::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/831ef374-8947-47f2-938f-5ec938f4fcef/master` is not mounted, skipping >MainThread::DEBUG::2014-06-04 11:48:53,463::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-06-04 11:48:53,475::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-06-04 11:48:53,476::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-06-04 11:48:53,584::hsm::423::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-06-04 11:48:53,584::hsm::447::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-06-04 11:48:53,586::hsm::479::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-06-04 11:48:53,586::hsm::480::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-06-04 11:48:53,586::hsm::482::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-06-04 11:48:53,587::hsm::525::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-06-04 11:48:53,587::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-06-04 11:48:53,588::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-06-04 11:48:53,607::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:48:53,608::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-06-04 11:48:53,608::misc::764::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-06-04 11:48:53,608::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-06-04 11:48:53,609::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:48:53,620::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:48:53,620::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >MainThread::DEBUG::2014-06-04 11:48:53,625::task::595::TaskManager.Task::(_updateState) Task=`c2efcf64-4271-4f51-b864-1edae1965a38`::moving from state init -> state preparing >MainThread::INFO::2014-06-04 11:48:53,660::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x2bfcab8>>) >MainThread::INFO::2014-06-04 11:48:53,660::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-06-04 11:48:53,660::task::1185::TaskManager.Task::(prepare) Task=`c2efcf64-4271-4f51-b864-1edae1965a38`::finished: None >MainThread::DEBUG::2014-06-04 11:48:53,660::task::595::TaskManager.Task::(_updateState) Task=`c2efcf64-4271-4f51-b864-1edae1965a38`::moving from state preparing -> state finished >MainThread::DEBUG::2014-06-04 11:48:53,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-06-04 11:48:53,661::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-06-04 11:48:53,661::task::990::TaskManager.Task::(_decref) Task=`c2efcf64-4271-4f51-b864-1edae1965a38`::ref 0 aborting False >MainThread::INFO::2014-06-04 11:48:53,665::momIF::47::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-06-04 11:48:53,673::vmChannels::187::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-06-04 11:48:53,674::vmChannels::170::vds::(run) Starting VM channels listener thread. >MainThread::WARNING::2014-06-04 11:48:53,692::clientIF::181::vds::(_prepareBindings) Unable to load the json rpc server module. Please make sure it is installed. >clientIFinit::DEBUG::2014-06-04 11:48:53,695::libvirtconnection::145::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-06-04 11:48:53,746::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:53,747::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,748::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,750::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,752::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,754::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,756::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,758::misc::772::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-06-04 11:48:53,760::lvm::324::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,773::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >clientIFinit::DEBUG::2014-06-04 11:48:53,820::clientIF::498::vds::(_recoverVm) Trying to recover 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >clientIFinit::INFO::2014-06-04 11:48:53,820::clientIF::366::vds::(createVm) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >clientIFinit::DEBUG::2014-06-04 11:48:53,822::libvirtconnection::145::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-06-04 11:48:53,903::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:53,904::lvm::349::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,904::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:53,909::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >clientIFinit::DEBUG::2014-06-04 11:48:53,952::clientIF::379::vds::(createVm) Total desktops after creation of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 1 >Thread-13::DEBUG::2014-06-04 11:48:53,953::vm::2242::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start >Thread-13::DEBUG::2014-06-04 11:48:53,955::vm::2246::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations acquired >Thread-13::INFO::2014-06-04 11:48:53,955::vm::3097::vm.Vm::(_run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::VM wrapper has started >Thread-13::WARNING::2014-06-04 11:48:53,955::vm::2062::vm.Vm::(buildConfDevices) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}' found >Thread-13::WARNING::2014-06-04 11:48:53,955::vm::2062::vm.Vm::(buildConfDevices) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}' found >Thread-13::DEBUG::2014-06-04 11:48:53,956::task::595::TaskManager.Task::(_updateState) Task=`cd6585fd-543e-4412-ad04-89e4bbf4b697`::moving from state init -> state preparing >Thread-13::INFO::2014-06-04 11:48:53,956::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID='ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', options=None) >Thread-13::ERROR::2014-06-04 11:48:53,956::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-13::ERROR::2014-06-04 11:48:53,957::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-13::DEBUG::2014-06-04 11:48:53,957::lvm::372::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-13::DEBUG::2014-06-04 11:48:53,957::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-15::DEBUG::2014-06-04 11:48:53,994::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call ping with () {} flowID [b83acfd] >Thread-15::DEBUG::2014-06-04 11:48:53,994::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-06-04 11:48:54,029::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:54,030::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-13::DEBUG::2014-06-04 11:48:54,065::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-06-04 11:48:54,066::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-06-04 11:48:54,067::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-13::DEBUG::2014-06-04 11:48:54,068::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-13::DEBUG::2014-06-04 11:48:54,073::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000707211 s, 2.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-06-04 11:48:54,073::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000707211 s, 2.9 MB/s'], size: 2048 >Thread-13::DEBUG::2014-06-04 11:48:54,073::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-13::WARNING::2014-06-04 11:48:54,073::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-13::DEBUG::2014-06-04 11:48:54,073::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-13::DEBUG::2014-06-04 11:48:54,074::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-06-04 11:48:54,074::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-06-04 11:48:54,074::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-06-04 11:48:54,074::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-06-04 11:48:54,074::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-06-04 11:48:54,075::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >storageRefresh::DEBUG::2014-06-04 11:48:54,147::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:54,153::lvm::372::OperationMutex::(_reloadvgs) Got the operational mutex >storageRefresh::DEBUG::2014-06-04 11:48:54,153::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-13::DEBUG::2014-06-04 11:48:54,181::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-06-04 11:48:54,182::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-13::DEBUG::2014-06-04 11:48:54,182::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS' >Thread-13::DEBUG::2014-06-04 11:48:54,183::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS' >Thread-13::DEBUG::2014-06-04 11:48:54,183::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS' >Thread-13::INFO::2014-06-04 11:48:54,184::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-13::DEBUG::2014-06-04 11:48:54,184::task::1185::TaskManager.Task::(prepare) Task=`cd6585fd-543e-4412-ad04-89e4bbf4b697`::finished: {'truesize': '26843545600', 'apparentsize': '26843545600'} >Thread-13::DEBUG::2014-06-04 11:48:54,184::task::595::TaskManager.Task::(_updateState) Task=`cd6585fd-543e-4412-ad04-89e4bbf4b697`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-06-04 11:48:54,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-06-04 11:48:54,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-06-04 11:48:54,184::task::990::TaskManager.Task::(_decref) Task=`cd6585fd-543e-4412-ad04-89e4bbf4b697`::ref 0 aborting False >Thread-13::DEBUG::2014-06-04 11:48:54,208::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-13::DEBUG::2014-06-04 11:48:54,208::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-13::DEBUG::2014-06-04 11:48:54,208::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-13::DEBUG::2014-06-04 11:48:54,209::vm::4986::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Looking for drive with attributes {'name': u'vda', 'bootOrder': u'1', 'boot': [<DOM Element: boot at 0x7ffa5810cc68>], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', 'type': u'disk'} >Thread-13::DEBUG::2014-06-04 11:48:54,209::vm::5007::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7ffa5810cc68>], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', u'disk')} >Thread-13::DEBUG::2014-06-04 11:48:54,209::vm::5026::vm.Vm::(_getUnderlyingDriveInfo) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Matched {'name': (u'vda', u'vda'), 'bootOrder': (u'1', u'1'), 'boot': ([<DOM Element: boot at 0x7ffa5810cc68>], None), 'readonly': (False, 'False'), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6', '/var/run/vdsm/storage/831ef374-8947-47f2-938f-5ec938f4fcef/43819d41-ad14-495b-8a53-0832945a6050/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6'), 'type': (u'disk', 'disk')} >Thread-13::DEBUG::2014-06-04 11:48:54,240::sampling::285::vm.Vm::(start) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Start statistics collection >Thread-16::DEBUG::2014-06-04 11:48:54,241::sampling::314::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread started >Thread-13::DEBUG::2014-06-04 11:48:54,255::vmChannels::194::vds::(register) Add fileno 29 to listener's channels. >Thread-13::WARNING::2014-06-04 11:48:54,257::vm::3661::vm.Vm::(_readPauseCode) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_readPauseCode unsupported by libvirt vm >storageRefresh::DEBUG::2014-06-04 11:48:54,265::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:54,266::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:54,266::lvm::660::Storage.LVM::(bootstrap) Skipping open lv: vg=831ef374-8947-47f2-938f-5ec938f4fcef lv=ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6 >storageRefresh::INFO::2014-06-04 11:48:54,266::lvm::665::Storage.LVM::(bootstrap) Deactivating lvs: vg=831ef374-8947-47f2-938f-5ec938f4fcef lvs=['df5b7676-a495-4383-bae9-acc1ae2dc830', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b'] >storageRefresh::DEBUG::2014-06-04 11:48:54,267::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/df5b7676-a495-4383-bae9-acc1ae2dc830 831ef374-8947-47f2-938f-5ec938f4fcef/81fbcbaf-2264-4fa8-831f-da5bf9b5281b' (cwd None) >Thread-13::DEBUG::2014-06-04 11:48:54,322::vm::2263::vm.Vm::(_startUnderlyingVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::_ongoingCreations released >storageRefresh::DEBUG::2014-06-04 11:48:54,395::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:54,396::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:54,396::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:54,396::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:54,396::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::INFO::2014-06-04 11:48:54,396::lvm::675::Storage.LVM::(bootstrap) Refreshing lvs: vg=831ef374-8947-47f2-938f-5ec938f4fcef lvs=['master', 'leases', 'inbox', 'outbox', 'ids', 'metadata'] >storageRefresh::DEBUG::2014-06-04 11:48:54,397::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --refresh 831ef374-8947-47f2-938f-5ec938f4fcef/master 831ef374-8947-47f2-938f-5ec938f4fcef/leases 831ef374-8947-47f2-938f-5ec938f4fcef/inbox 831ef374-8947-47f2-938f-5ec938f4fcef/outbox 831ef374-8947-47f2-938f-5ec938f4fcef/ids 831ef374-8947-47f2-938f-5ec938f4fcef/metadata' (cwd None) >Thread-15::DEBUG::2014-06-04 11:48:54,572::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call ping with () {} flowID [b83acfd] >Thread-15::DEBUG::2014-06-04 11:48:54,572::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-06-04 11:48:54,664::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-06-04 11:48:54,665::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-06-04 11:48:54,665::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::WARNING::2014-06-04 11:48:54,666::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >storageRefresh::DEBUG::2014-06-04 11:48:54,666::hsm::391::Storage.HSM::(storageRefresh) HSM is ready >VM Channels Listener::DEBUG::2014-06-04 11:48:54,687::vmChannels::102::vds::(_do_add_channels) fileno 29 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-06-04 11:48:54,687::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 29. >VM Channels Listener::DEBUG::2014-06-04 11:48:54,687::guestIF::147::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Attempting connection to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:48:54,688::guestIF::150::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Connected to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:48:54,689::vmChannels::144::vds::(_handle_unconnected) Connecting to fileno 29 succeeded. >clientIFinit::DEBUG::2014-06-04 11:48:54,954::task::595::TaskManager.Task::(_updateState) Task=`851ef478-6529-4588-ad36-92439bfe101b`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:48:54,955::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:48:54,955::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:48:54,955::task::1185::TaskManager.Task::(prepare) Task=`851ef478-6529-4588-ad36-92439bfe101b`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:48:54,955::task::595::TaskManager.Task::(_updateState) Task=`851ef478-6529-4588-ad36-92439bfe101b`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:48:54,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:48:54,955::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:48:54,955::task::990::TaskManager.Task::(_decref) Task=`851ef478-6529-4588-ad36-92439bfe101b`::ref 0 aborting False >Thread-15::DEBUG::2014-06-04 11:48:55,089::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call ping with () {} flowID [b83acfd] >Thread-15::DEBUG::2014-06-04 11:48:55,089::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-15::DEBUG::2014-06-04 11:48:55,099::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call getCapabilities with () {} flowID [b83acfd] >Thread-15::DEBUG::2014-06-04 11:48:55,143::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2014-06-04 11:48:55,149::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-06-04 11:48:55,178::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['vnet0', 'eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'DEVICE': 'eth0', 'HWADDR': 'a4:5d:36:11:e1:cc', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'ovirtmgmt'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '3100.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '10.34.63.55'}} >Thread-15::DEBUG::2014-06-04 11:48:55,391::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call getCapabilities with () {} >Thread-15::DEBUG::2014-06-04 11:48:55,392::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2014-06-04 11:48:55,397::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-06-04 11:48:55,415::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['vnet0', 'eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'DEVICE': 'eth0', 'HWADDR': 'a4:5d:36:11:e1:cc', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'ovirtmgmt'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '3100.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '10.34.63.55'}} >Thread-15::DEBUG::2014-06-04 11:48:55,440::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call getHardwareInfo with () {} >Thread-15::DEBUG::2014-06-04 11:48:55,471::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL320e Gen8', 'systemSerialNumber': 'CZ134300VX', 'systemFamily': 'ProLiant', 'systemVersion': 'Not Specified', 'systemUUID': '30303734-3536-5A43-3133-343330305658', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2014-06-04 11:48:55,549::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call getCapabilities with () {} >Thread-15::DEBUG::2014-06-04 11:48:55,550::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2014-06-04 11:48:55,554::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-06-04 11:48:55,571::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['vnet0', 'eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['vnet0', 'eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'DEVICE': 'eth0', 'HWADDR': 'a4:5d:36:11:e1:cc', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'ovirtmgmt'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '3100.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '10.34.63.55'}} >Thread-15::DEBUG::2014-06-04 11:48:55,587::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call getHardwareInfo with () {} >Thread-15::DEBUG::2014-06-04 11:48:55,588::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'ProLiant DL320e Gen8', 'systemSerialNumber': 'CZ134300VX', 'systemFamily': 'ProLiant', 'systemVersion': 'Not Specified', 'systemUUID': '30303734-3536-5A43-3133-343330305658', 'systemManufacturer': 'HP'}} >Thread-15::DEBUG::2014-06-04 11:48:55,704::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-15::DEBUG::2014-06-04 11:48:55,705::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-15::DEBUG::2014-06-04 11:48:55,705::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-15::DEBUG::2014-06-04 11:48:55,705::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-15::DEBUG::2014-06-04 11:48:55,705::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-15::DEBUG::2014-06-04 11:48:55,705::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-15::DEBUG::2014-06-04 11:48:55,705::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-15::DEBUG::2014-06-04 11:48:55,705::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.46', 'elapsedTime': '1925', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-15::DEBUG::2014-06-04 11:48:55,790::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': True},) {} flowID [7616379b] >Thread-15::DEBUG::2014-06-04 11:48:55,837::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,725::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,726::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,726::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,726::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,726::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:48:58,726::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-15::DEBUG::2014-06-04 11:48:59,250::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-15::DEBUG::2014-06-04 11:48:59,250::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-15::DEBUG::2014-06-04 11:48:59,251::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-15::DEBUG::2014-06-04 11:48:59,251::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-15::DEBUG::2014-06-04 11:48:59,251::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-15::DEBUG::2014-06-04 11:48:59,251::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-15::DEBUG::2014-06-04 11:48:59,251::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-15::DEBUG::2014-06-04 11:48:59,251::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.00', 'elapsedTime': '1929', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >clientIFinit::DEBUG::2014-06-04 11:48:59,961::task::595::TaskManager.Task::(_updateState) Task=`c2d163d9-7ef6-4a80-912c-6c7eb56a97df`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:48:59,961::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:48:59,961::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:48:59,961::task::1185::TaskManager.Task::(prepare) Task=`c2d163d9-7ef6-4a80-912c-6c7eb56a97df`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:48:59,961::task::595::TaskManager.Task::(_updateState) Task=`c2d163d9-7ef6-4a80-912c-6c7eb56a97df`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:48:59,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:48:59,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:48:59,961::task::990::TaskManager.Task::(_decref) Task=`c2d163d9-7ef6-4a80-912c-6c7eb56a97df`::ref 0 aborting False >Thread-17::DEBUG::2014-06-04 11:49:02,140::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-17::DEBUG::2014-06-04 11:49:02,140::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-17::DEBUG::2014-06-04 11:49:02,141::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-17::DEBUG::2014-06-04 11:49:02,141::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-17::DEBUG::2014-06-04 11:49:02,141::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-17::DEBUG::2014-06-04 11:49:02,141::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-17::DEBUG::2014-06-04 11:49:02,141::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-17::DEBUG::2014-06-04 11:49:02,141::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.89', 'elapsedTime': '1932', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >Thread-15::DEBUG::2014-06-04 11:49:02,644::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.55]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-15::DEBUG::2014-06-04 11:49:02,644::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-15::DEBUG::2014-06-04 11:49:02,644::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-15::DEBUG::2014-06-04 11:49:02,645::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-15::DEBUG::2014-06-04 11:49:02,645::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-15::DEBUG::2014-06-04 11:49:02,645::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-15::DEBUG::2014-06-04 11:49:02,645::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-15::DEBUG::2014-06-04 11:49:02,645::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.40', 'elapsedTime': '1932', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,731::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,732::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,733::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,733::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,733::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:03,733::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >clientIFinit::DEBUG::2014-06-04 11:49:04,967::task::595::TaskManager.Task::(_updateState) Task=`872f594e-5687-4673-ae6d-6845125244f9`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:49:04,968::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:49:04,981::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:04,981::task::1185::TaskManager.Task::(prepare) Task=`872f594e-5687-4673-ae6d-6845125244f9`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:04,981::task::595::TaskManager.Task::(_updateState) Task=`872f594e-5687-4673-ae6d-6845125244f9`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:49:04,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:49:04,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:49:04,981::task::990::TaskManager.Task::(_decref) Task=`872f594e-5687-4673-ae6d-6845125244f9`::ref 0 aborting False >Thread-15::DEBUG::2014-06-04 11:49:05,719::task::595::TaskManager.Task::(_updateState) Task=`e508937c-1971-4baa-8fdf-082173e5e13d`::moving from state init -> state preparing >Thread-15::INFO::2014-06-04 11:49:05,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-06-04 11:49:05,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-06-04 11:49:05,719::task::1185::TaskManager.Task::(prepare) Task=`e508937c-1971-4baa-8fdf-082173e5e13d`::finished: {} >Thread-15::DEBUG::2014-06-04 11:49:05,719::task::595::TaskManager.Task::(_updateState) Task=`e508937c-1971-4baa-8fdf-082173e5e13d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-06-04 11:49:05,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-06-04 11:49:05,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-06-04 11:49:05,719::task::990::TaskManager.Task::(_decref) Task=`e508937c-1971-4baa-8fdf-082173e5e13d`::ref 0 aborting False >Thread-15::ERROR::2014-06-04 11:49:05,720::brokerlink::72::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Failed to connect to broker: [Errno 2] No such file or directory >Thread-15::ERROR::2014-06-04 11:49:05,724::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1603, in _getHaInfo > stats = instance.get_all_stats() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 97, in get_all_stats > with broker.connection(): > File "/usr/lib64/python2.6/contextlib.py", line 16, in __enter__ > return self.gen.next() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 96, in connection > self.connect() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 64, in connect > self._socket.connect(constants.BROKER_SOCKET_FILE) > File "<string>", line 1, in connect >error: [Errno 2] No such file or directory >Thread-15::DEBUG::2014-06-04 11:49:05,748::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-15::DEBUG::2014-06-04 11:49:05,748::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-15::DEBUG::2014-06-04 11:49:05,749::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-15::DEBUG::2014-06-04 11:49:05,749::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-15::DEBUG::2014-06-04 11:49:05,749::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-15::DEBUG::2014-06-04 11:49:05,749::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-18::DEBUG::2014-06-04 11:49:07,199::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-18::DEBUG::2014-06-04 11:49:07,199::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-18::DEBUG::2014-06-04 11:49:07,199::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >Thread-18::DEBUG::2014-06-04 11:49:07,200::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-18::DEBUG::2014-06-04 11:49:07,200::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-18::DEBUG::2014-06-04 11:49:07,200::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-18::DEBUG::2014-06-04 11:49:07,200::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-18::DEBUG::2014-06-04 11:49:07,200::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4c:10:3f:11', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '0.00', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.95', 'elapsedTime': '1937', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,738::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,738::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::587::vm.Vm::(_getCpuStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::623::vm.Vm::(_getNetworkStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Network stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,739::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:08,740::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >clientIFinit::DEBUG::2014-06-04 11:49:09,987::task::595::TaskManager.Task::(_updateState) Task=`21d139d6-a658-49a0-a599-5c364833e142`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:49:09,987::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:49:10,015::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:10,015::task::1185::TaskManager.Task::(prepare) Task=`21d139d6-a658-49a0-a599-5c364833e142`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:10,015::task::595::TaskManager.Task::(_updateState) Task=`21d139d6-a658-49a0-a599-5c364833e142`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:49:10,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:49:10,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:49:10,015::task::990::TaskManager.Task::(_decref) Task=`21d139d6-a658-49a0-a599-5c364833e142`::ref 0 aborting False >Thread-19::DEBUG::2014-06-04 11:49:12,252::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-19::DEBUG::2014-06-04 11:49:12,253::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-19::DEBUG::2014-06-04 11:49:12,253::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-19::DEBUG::2014-06-04 11:49:12,253::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-19::DEBUG::2014-06-04 11:49:12,253::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-19::DEBUG::2014-06-04 11:49:12,253::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4c:10:3f:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '21.15', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.99', 'elapsedTime': '1942', 'vmType': 'kvm', 'cpuSys': '0.20', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,745::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,745::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,745::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,745::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,745::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,746::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,746::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:13,746::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >clientIFinit::DEBUG::2014-06-04 11:49:15,021::task::595::TaskManager.Task::(_updateState) Task=`8dce0137-dfda-4150-90f9-63e9dda32aeb`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:49:15,021::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:49:15,040::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:15,041::task::1185::TaskManager.Task::(prepare) Task=`8dce0137-dfda-4150-90f9-63e9dda32aeb`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:15,041::task::595::TaskManager.Task::(_updateState) Task=`8dce0137-dfda-4150-90f9-63e9dda32aeb`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:49:15,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:49:15,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:49:15,041::task::990::TaskManager.Task::(_decref) Task=`8dce0137-dfda-4150-90f9-63e9dda32aeb`::ref 0 aborting False >Thread-20::DEBUG::2014-06-04 11:49:17,305::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-20::DEBUG::2014-06-04 11:49:17,306::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-20::DEBUG::2014-06-04 11:49:17,306::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-20::DEBUG::2014-06-04 11:49:17,306::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-20::DEBUG::2014-06-04 11:49:17,306::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-20::DEBUG::2014-06-04 11:49:17,306::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4c:10:3f:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '21.15', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.04', 'elapsedTime': '1947', 'vmType': 'kvm', 'cpuSys': '0.20', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,751::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,751::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,752::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,752::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,752::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,752::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,752::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:18,752::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >clientIFinit::DEBUG::2014-06-04 11:49:20,046::task::595::TaskManager.Task::(_updateState) Task=`d21a235b-6658-48d3-8c87-70d3e8f91ffa`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:49:20,047::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:49:20,065::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:20,066::task::1185::TaskManager.Task::(prepare) Task=`d21a235b-6658-48d3-8c87-70d3e8f91ffa`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:20,066::task::595::TaskManager.Task::(_updateState) Task=`d21a235b-6658-48d3-8c87-70d3e8f91ffa`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:49:20,066::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:49:20,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:49:20,066::task::990::TaskManager.Task::(_decref) Task=`d21a235b-6658-48d3-8c87-70d3e8f91ffa`::ref 0 aborting False >Thread-21::DEBUG::2014-06-04 11:49:22,364::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-21::DEBUG::2014-06-04 11:49:22,365::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-21::DEBUG::2014-06-04 11:49:22,365::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-21::DEBUG::2014-06-04 11:49:22,365::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-21::DEBUG::2014-06-04 11:49:22,365::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-21::DEBUG::2014-06-04 11:49:22,365::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '0', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4c:10:3f:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '21.15', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '0.10', 'elapsedTime': '1952', 'vmType': 'kvm', 'cpuSys': '0.20', 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,753::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,753::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,754::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,754::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,754::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,754::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,754::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >GuestMonitor-HostedEngine::DEBUG::2014-06-04 11:49:23,754::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >VM Channels Listener::DEBUG::2014-06-04 11:49:24,720::vmChannels::91::vds::(_handle_timeouts) Timeout on fileno 29. >clientIFinit::DEBUG::2014-06-04 11:49:25,072::task::595::TaskManager.Task::(_updateState) Task=`fa888be8-1d50-451b-9b6b-edc5ab7522a0`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:49:25,072::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:49:25,107::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:25,108::task::1185::TaskManager.Task::(prepare) Task=`fa888be8-1d50-451b-9b6b-edc5ab7522a0`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:25,108::task::595::TaskManager.Task::(_updateState) Task=`fa888be8-1d50-451b-9b6b-edc5ab7522a0`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:49:25,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:49:25,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:49:25,108::task::990::TaskManager.Task::(_decref) Task=`fa888be8-1d50-451b-9b6b-edc5ab7522a0`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:49:26,533::vm::2433::vm.Vm::(_rtcUpdate) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::new rtc offset 7200 >Thread-22::DEBUG::2014-06-04 11:49:27,417::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-22::DEBUG::2014-06-04 11:49:27,417::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc stats not available >Thread-22::DEBUG::2014-06-04 11:49:27,418::vm::645::vm.Vm::(_getDiskStats) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda stats not available >Thread-22::DEBUG::2014-06-04 11:49:27,418::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk hdc latency not available >Thread-22::DEBUG::2014-06-04 11:49:27,418::vm::684::vm.Vm::(_getDiskLatency) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Disk vda latency not available >Thread-22::DEBUG::2014-06-04 11:49:27,418::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '39967', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': '-1', 'timeOffset': '7200', 'hash': '-4370638447245755726', 'balloonInfo': {}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4c:10:3f:11', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'displayType': 'vnc', 'cpuUser': '11.91', 'disks': {u'vda': {'truesize': '26843545600', 'apparentsize': '26843545600', 'imageID': '43819d41-ad14-495b-8a53-0832945a6050'}, u'hdc': {'truesize': '0', 'apparentsize': '0'}}, 'monitorResponse': '0', 'statsAge': '1.15', 'elapsedTime': '1957', 'vmType': 'kvm', 'cpuSys': '0.87', 'appsList': [], 'guestIPs': ''}]} >libvirtEventLoop::DEBUG::2014-06-04 11:49:27,684::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Shutdown detail 0 opaque None >VM Channels Listener::ERROR::2014-06-04 11:49:27,735::vmChannels::53::vds::(_handle_event) Received 00000019 on fileno 29 >VM Channels Listener::DEBUG::2014-06-04 11:49:27,736::vmChannels::128::vds::(_handle_unconnected) Trying to connect fileno 19. >VM Channels Listener::DEBUG::2014-06-04 11:49:27,736::guestIF::147::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Attempting connection to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-06-04 11:49:27,737::guestIF::158::vm.Vm::(_connect) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Failed to connect to /var/lib/libvirt/qemu/channels/8adf82c9-1900-4fd9-8ba4-d73b55146b5b.com.redhat.rhevm.vdsm with 111 >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,019::vm::5130::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::event Stopped detail 0 opaque None >libvirtEventLoop::INFO::2014-06-04 11:49:28,019::vm::2324::vm.Vm::(_onQemuDeath) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::underlying process disconnected >libvirtEventLoop::INFO::2014-06-04 11:49:28,019::vm::4575::vm.Vm::(releaseVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Release VM resources >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,022::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,022::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >Thread-16::DEBUG::2014-06-04 11:49:28,022::sampling::323::vm.Vm::(run) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stats thread finished >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,022::vmChannels::205::vds::(unregister) Delete fileno 19 from listener. >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,023::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,023::task::595::TaskManager.Task::(_updateState) Task=`9b4430a0-ff87-4772-b39d-04f3cc199de2`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-06-04 11:49:28,023::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='43819d41-ad14-495b-8a53-0832945a6050', volUUID=None) >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,024::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`26588715-1ca0-4b9b-b208-bca7c2421fac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3285' at 'teardownImage' >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,024::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,024::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,024::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`26588715-1ca0-4b9b-b208-bca7c2421fac`::Granted request >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,024::task::827::TaskManager.Task::(resourceAcquired) Task=`9b4430a0-ff87-4772-b39d-04f3cc199de2`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,024::task::990::TaskManager.Task::(_decref) Task=`9b4430a0-ff87-4772-b39d-04f3cc199de2`::ref 1 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,025::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,025::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,160::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,165::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,165::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,166::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 831ef374-8947-47f2-938f-5ec938f4fcef/ccbfdd43-1dbe-4fae-8d87-63a9b4887cc6' (cwd None) >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,292::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,293::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,293::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >libvirtEventLoop::INFO::2014-06-04 11:49:28,293::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,293::task::1185::TaskManager.Task::(prepare) Task=`9b4430a0-ff87-4772-b39d-04f3cc199de2`::finished: None >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,293::task::595::TaskManager.Task::(_updateState) Task=`9b4430a0-ff87-4772-b39d-04f3cc199de2`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,294::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,294::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,294::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,294::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,294::task::990::TaskManager.Task::(_decref) Task=`9b4430a0-ff87-4772-b39d-04f3cc199de2`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,295::task::595::TaskManager.Task::(_updateState) Task=`7a14772e-e3db-494b-93c2-5b8c1db75314`::moving from state init -> state preparing >libvirtEventLoop::INFO::2014-06-04 11:49:28,296::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='8adf82c9-1900-4fd9-8ba4-d73b55146b5b') >libvirtEventLoop::INFO::2014-06-04 11:49:28,301::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,301::task::1185::TaskManager.Task::(prepare) Task=`7a14772e-e3db-494b-93c2-5b8c1db75314`::finished: None >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,302::task::595::TaskManager.Task::(_updateState) Task=`7a14772e-e3db-494b-93c2-5b8c1db75314`::moving from state preparing -> state finished >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,302::task::990::TaskManager.Task::(_decref) Task=`7a14772e-e3db-494b-93c2-5b8c1db75314`::ref 0 aborting False >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,308::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,308::vm::2731::vm.Vm::(setDownStatus) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Changed state to Down: User shut down >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,308::sampling::292::vm.Vm::(stop) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Stop statistics collection >libvirtEventLoop::DEBUG::2014-06-04 11:49:28,312::libvirtconnection::124::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '8adf82c9-1900-4fd9-8ba4-d73b55146b5b' >VM Channels Listener::DEBUG::2014-06-04 11:49:28,738::vmChannels::112::vds::(_do_del_channels) fileno 19 was removed from listener. >clientIFinit::DEBUG::2014-06-04 11:49:30,113::task::595::TaskManager.Task::(_updateState) Task=`dff90a28-5648-433f-9a40-f327f713034a`::moving from state init -> state preparing >clientIFinit::INFO::2014-06-04 11:49:30,114::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >clientIFinit::INFO::2014-06-04 11:49:30,114::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:30,114::task::1185::TaskManager.Task::(prepare) Task=`dff90a28-5648-433f-9a40-f327f713034a`::finished: {'poollist': []} >clientIFinit::DEBUG::2014-06-04 11:49:30,114::task::595::TaskManager.Task::(_updateState) Task=`dff90a28-5648-433f-9a40-f327f713034a`::moving from state preparing -> state finished >clientIFinit::DEBUG::2014-06-04 11:49:30,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >clientIFinit::DEBUG::2014-06-04 11:49:30,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >clientIFinit::DEBUG::2014-06-04 11:49:30,114::task::990::TaskManager.Task::(_decref) Task=`dff90a28-5648-433f-9a40-f327f713034a`::ref 0 aborting False >Thread-23::DEBUG::2014-06-04 11:49:32,477::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-23::DEBUG::2014-06-04 11:49:32,477::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'hash': '-4370638447245755726', 'exitMessage': 'User shut down', 'vmId': '8adf82c9-1900-4fd9-8ba4-d73b55146b5b', 'timeOffset': '7200', 'exitCode': 0}]} >Thread-24::DEBUG::2014-06-04 11:49:32,608::BindingXMLRPC::1067::vds::(wrapper) client [127.0.0.1]::call vmDestroy with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-24::INFO::2014-06-04 11:49:32,608::API::327::vds::(destroy) vmContainerLock acquired by vm 8adf82c9-1900-4fd9-8ba4-d73b55146b5b >Thread-24::DEBUG::2014-06-04 11:49:32,608::vm::4629::vm.Vm::(destroy) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::destroy Called >Thread-24::DEBUG::2014-06-04 11:49:32,609::vm::4623::vm.Vm::(deleteVm) vmId=`8adf82c9-1900-4fd9-8ba4-d73b55146b5b`::Total desktops after destroy of 8adf82c9-1900-4fd9-8ba4-d73b55146b5b is 0 >Thread-24::DEBUG::2014-06-04 11:49:32,609::BindingXMLRPC::1074::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >Thread-25::DEBUG::2014-06-04 11:49:33,057::BindingXMLRPC::251::vds::(wrapper) client [127.0.0.1] >Thread-25::DEBUG::2014-06-04 11:49:33,061::task::595::TaskManager.Task::(_updateState) Task=`9b3f6e04-bcae-45a4-9064-7bfc57434cc4`::moving from state init -> state preparing >Thread-25::INFO::2014-06-04 11:49:33,061::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', conList=[{'connection': '10.34.131.193', 'iqn': 'iqn.2009-02.com.example:for.all', 'portal': '1', 'user': 'engine', 'password': '******', 'id': 'dddf7858-0e5f-46fa-9c5b-a5f56fc21e69', 'port': '3260'}], options=None) >Thread-25::DEBUG::2014-06-04 11:49:33,061::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 --op=new' (cwd None) >Thread-25::DEBUG::2014-06-04 11:49:33,088::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:49:33,088::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.session.auth.authmethod -v **** --op=update' (cwd None) >Thread-25::DEBUG::2014-06-04 11:49:33,097::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:49:33,098::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.session.auth.username -v **** --op=update' (cwd None) >Thread-25::DEBUG::2014-06-04 11:49:33,123::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:49:33,123::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.session.auth.password -v **** --op=update' (cwd None) >Thread-25::DEBUG::2014-06-04 11:49:33,150::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:49:33,173::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -l' (cwd None) >Thread-25::DEBUG::2014-06-04 11:49:33,183::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:49:33,183::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.2009-02.com.example:for.all -I default -p 10.34.131.193:3260 -n node.startup -v manual --op=update' (cwd None) >Thread-25::DEBUG::2014-06-04 11:49:33,192::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-25::DEBUG::2014-06-04 11:49:33,193::hsm::2341::Storage.HSM::(__prefetchDomains) Found SD uuids: ('831ef374-8947-47f2-938f-5ec938f4fcef',) >Thread-25::DEBUG::2014-06-04 11:49:33,193::hsm::2397::Storage.HSM::(connectStorageServer) knownSDs: {831ef374-8947-47f2-938f-5ec938f4fcef: storage.blockSD.findDomain} >Thread-25::INFO::2014-06-04 11:49:33,193::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'dddf7858-0e5f-46fa-9c5b-a5f56fc21e69'}]} >Thread-25::DEBUG::2014-06-04 11:49:33,193::task::1185::TaskManager.Task::(prepare) Task=`9b3f6e04-bcae-45a4-9064-7bfc57434cc4`::finished: {'statuslist': [{'status': 0, 'id': 'dddf7858-0e5f-46fa-9c5b-a5f56fc21e69'}]} >Thread-25::DEBUG::2014-06-04 11:49:33,193::task::595::TaskManager.Task::(_updateState) Task=`9b3f6e04-bcae-45a4-9064-7bfc57434cc4`::moving from state preparing -> state finished >Thread-25::DEBUG::2014-06-04 11:49:33,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-25::DEBUG::2014-06-04 11:49:33,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-25::DEBUG::2014-06-04 11:49:33,194::task::990::TaskManager.Task::(_decref) Task=`9b3f6e04-bcae-45a4-9064-7bfc57434cc4`::ref 0 aborting False >Thread-26::DEBUG::2014-06-04 11:49:33,255::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-26::DEBUG::2014-06-04 11:49:33,256::task::595::TaskManager.Task::(_updateState) Task=`2985ead2-07f8-44ae-af19-2bc7accf0d29`::moving from state init -> state preparing >Thread-26::INFO::2014-06-04 11:49:33,256::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-26::INFO::2014-06-04 11:49:33,256::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-26::DEBUG::2014-06-04 11:49:33,256::task::1185::TaskManager.Task::(prepare) Task=`2985ead2-07f8-44ae-af19-2bc7accf0d29`::finished: {} >Thread-26::DEBUG::2014-06-04 11:49:33,256::task::595::TaskManager.Task::(_updateState) Task=`2985ead2-07f8-44ae-af19-2bc7accf0d29`::moving from state preparing -> state finished >Thread-26::DEBUG::2014-06-04 11:49:33,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-26::DEBUG::2014-06-04 11:49:33,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-26::DEBUG::2014-06-04 11:49:33,256::task::990::TaskManager.Task::(_decref) Task=`2985ead2-07f8-44ae-af19-2bc7accf0d29`::ref 0 aborting False >Thread-27::DEBUG::2014-06-04 11:49:33,308::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-27::DEBUG::2014-06-04 11:49:33,308::task::595::TaskManager.Task::(_updateState) Task=`d38f78a7-3f9c-4db3-844b-bed1d42d19d5`::moving from state init -> state preparing >Thread-27::INFO::2014-06-04 11:49:33,309::logUtils::44::dispatcher::(wrapper) Run and protect: startMonitoringDomain(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', hostID=1, options=None) >Thread-27::DEBUG::2014-06-04 11:49:33,309::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`cadd2a12-8b1a-435c-9124-2b5bee73e3ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3673' at 'startMonitoringDomain' >Thread-27::DEBUG::2014-06-04 11:49:33,309::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-27::DEBUG::2014-06-04 11:49:33,309::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-27::DEBUG::2014-06-04 11:49:33,309::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`cadd2a12-8b1a-435c-9124-2b5bee73e3ce`::Granted request >Thread-27::INFO::2014-06-04 11:49:33,310::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 11:49:33,310::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-27::DEBUG::2014-06-04 11:49:33,310::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-28::DEBUG::2014-06-04 11:49:33,311::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-27::DEBUG::2014-06-04 11:49:33,311::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-28::DEBUG::2014-06-04 11:49:33,311::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-27::DEBUG::2014-06-04 11:49:33,312::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-28::DEBUG::2014-06-04 11:49:33,312::misc::762::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-27::DEBUG::2014-06-04 11:49:33,312::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-28::DEBUG::2014-06-04 11:49:33,313::misc::764::SamplingMethod::(__call__) Got in to sampling method >Thread-27::INFO::2014-06-04 11:49:33,313::logUtils::47::dispatcher::(wrapper) Run and protect: startMonitoringDomain, Return response: None >Thread-28::DEBUG::2014-06-04 11:49:33,313::iscsi::393::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-27::DEBUG::2014-06-04 11:49:33,314::task::1185::TaskManager.Task::(prepare) Task=`d38f78a7-3f9c-4db3-844b-bed1d42d19d5`::finished: None >Thread-27::DEBUG::2014-06-04 11:49:33,314::task::595::TaskManager.Task::(_updateState) Task=`d38f78a7-3f9c-4db3-844b-bed1d42d19d5`::moving from state preparing -> state finished >Thread-28::DEBUG::2014-06-04 11:49:33,314::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-27::DEBUG::2014-06-04 11:49:33,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-27::DEBUG::2014-06-04 11:49:33,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-27::DEBUG::2014-06-04 11:49:33,319::task::990::TaskManager.Task::(_decref) Task=`d38f78a7-3f9c-4db3-844b-bed1d42d19d5`::ref 0 aborting False >Thread-28::DEBUG::2014-06-04 11:49:33,330::misc::772::SamplingMethod::(__call__) Returning last result >Thread-28::DEBUG::2014-06-04 11:49:33,330::multipath::110::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath -r' (cwd None) >Thread-29::DEBUG::2014-06-04 11:49:33,366::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-29::DEBUG::2014-06-04 11:49:33,367::task::595::TaskManager.Task::(_updateState) Task=`3307e7e6-c966-4d3a-bdda-3d12418831ab`::moving from state init -> state preparing >Thread-29::INFO::2014-06-04 11:49:33,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-29::INFO::2014-06-04 11:49:33,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': True}} >Thread-29::DEBUG::2014-06-04 11:49:33,367::task::1185::TaskManager.Task::(prepare) Task=`3307e7e6-c966-4d3a-bdda-3d12418831ab`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': True}} >Thread-29::DEBUG::2014-06-04 11:49:33,367::task::595::TaskManager.Task::(_updateState) Task=`3307e7e6-c966-4d3a-bdda-3d12418831ab`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-06-04 11:49:33,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2014-06-04 11:49:33,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-06-04 11:49:33,368::task::990::TaskManager.Task::(_decref) Task=`3307e7e6-c966-4d3a-bdda-3d12418831ab`::ref 0 aborting False >Thread-28::DEBUG::2014-06-04 11:49:33,411::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:49:33,411::lvm::496::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,411::lvm::498::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,411::lvm::507::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,411::lvm::509::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,412::lvm::527::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,412::lvm::529::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,412::misc::772::SamplingMethod::(__call__) Returning last result >Thread-28::DEBUG::2014-06-04 11:49:33,412::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,414::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:33,548::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:49:33,549::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,549::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:49:33,551::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:33,557::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000779064 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:49:33,557::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000779064 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 11:49:33,557::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 11:49:33,557::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 11:49:33,557::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:49:33,557::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,558::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,558::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,558::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,558::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,558::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:33,664::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:49:33,665::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:49:33,666::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 11:49:33,666::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 11:49:33,666::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 11:49:33,666::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 11:49:33,667::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:33,773::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:49:33,775::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:33,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000923233 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:49:33,784::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 831ef374-8947-47f2-938f-5ec938f4fcef changed its status to Valid >Thread-30::DEBUG::2014-06-04 11:49:38,427::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-30::DEBUG::2014-06-04 11:49:38,428::task::595::TaskManager.Task::(_updateState) Task=`720bf413-086f-4c71-8322-d9d1caacacc1`::moving from state init -> state preparing >Thread-30::INFO::2014-06-04 11:49:38,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-30::INFO::2014-06-04 11:49:38,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000923233', 'lastCheck': '4.6', 'valid': True}} >Thread-30::DEBUG::2014-06-04 11:49:38,428::task::1185::TaskManager.Task::(prepare) Task=`720bf413-086f-4c71-8322-d9d1caacacc1`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000923233', 'lastCheck': '4.6', 'valid': True}} >Thread-30::DEBUG::2014-06-04 11:49:38,428::task::595::TaskManager.Task::(_updateState) Task=`720bf413-086f-4c71-8322-d9d1caacacc1`::moving from state preparing -> state finished >Thread-30::DEBUG::2014-06-04 11:49:38,428::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2014-06-04 11:49:38,428::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2014-06-04 11:49:38,428::task::990::TaskManager.Task::(_decref) Task=`720bf413-086f-4c71-8322-d9d1caacacc1`::ref 0 aborting False >Thread-31::DEBUG::2014-06-04 11:49:38,489::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call getCapabilities with () {} >Thread-31::DEBUG::2014-06-04 11:49:38,490::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-32::DEBUG::2014-06-04 11:49:38,495::task::595::TaskManager.Task::(_updateState) Task=`c4b9334c-4f6c-48a1-b300-9ba09e528998`::moving from state init -> state preparing >Thread-32::INFO::2014-06-04 11:49:38,495::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-32::INFO::2014-06-04 11:49:38,495::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000923233', 'lastCheck': '4.7', 'valid': True}} >Thread-32::DEBUG::2014-06-04 11:49:38,496::task::1185::TaskManager.Task::(prepare) Task=`c4b9334c-4f6c-48a1-b300-9ba09e528998`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000923233', 'lastCheck': '4.7', 'valid': True}} >Thread-32::DEBUG::2014-06-04 11:49:38,496::task::595::TaskManager.Task::(_updateState) Task=`c4b9334c-4f6c-48a1-b300-9ba09e528998`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-06-04 11:49:38,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-32::DEBUG::2014-06-04 11:49:38,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-06-04 11:49:38,496::task::990::TaskManager.Task::(_decref) Task=`c4b9334c-4f6c-48a1-b300-9ba09e528998`::ref 0 aborting False >Thread-31::DEBUG::2014-06-04 11:49:38,498::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-33::DEBUG::2014-06-04 11:49:38,499::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-33::DEBUG::2014-06-04 11:49:38,499::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-34::DEBUG::2014-06-04 11:49:38,503::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-34::DEBUG::2014-06-04 11:49:38,504::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-32::ERROR::2014-06-04 11:49:38,509::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1603, in _getHaInfo > stats = instance.get_all_stats() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 100, in get_all_stats > stats = broker.get_stats_from_storage(service) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 229, in get_stats_from_storage > result = self._checked_communicate(request) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 257, in _checked_communicate > .format(message or response)) >RequestError: Request failed: <type 'exceptions.OSError'> >Thread-31::DEBUG::2014-06-04 11:49:38,529::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'DEVICE': 'eth0', 'HWADDR': 'a4:5d:36:11:e1:cc', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'ovirtmgmt'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '3100.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '10.34.63.104'}} >Thread-28::DEBUG::2014-06-04 11:49:43,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:43,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00143255 s, 2.9 MB/s\n'; <rc> = 0 >Thread-35::DEBUG::2014-06-04 11:49:48,500::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call getCapabilities with () {} >Thread-35::DEBUG::2014-06-04 11:49:48,505::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-36::DEBUG::2014-06-04 11:49:48,511::task::595::TaskManager.Task::(_updateState) Task=`bef58c05-9f41-4548-8192-68d8d6e189c8`::moving from state init -> state preparing >Thread-37::DEBUG::2014-06-04 11:49:48,511::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-36::INFO::2014-06-04 11:49:48,513::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-37::DEBUG::2014-06-04 11:49:48,513::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-36::INFO::2014-06-04 11:49:48,514::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143255', 'lastCheck': '4.7', 'valid': True}} >Thread-35::DEBUG::2014-06-04 11:49:48,515::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-36::DEBUG::2014-06-04 11:49:48,515::task::1185::TaskManager.Task::(prepare) Task=`bef58c05-9f41-4548-8192-68d8d6e189c8`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00143255', 'lastCheck': '4.7', 'valid': True}} >Thread-36::DEBUG::2014-06-04 11:49:48,517::task::595::TaskManager.Task::(_updateState) Task=`bef58c05-9f41-4548-8192-68d8d6e189c8`::moving from state preparing -> state finished >Thread-36::DEBUG::2014-06-04 11:49:48,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2014-06-04 11:49:48,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2014-06-04 11:49:48,518::task::990::TaskManager.Task::(_decref) Task=`bef58c05-9f41-4548-8192-68d8d6e189c8`::ref 0 aborting False >Thread-36::ERROR::2014-06-04 11:49:48,530::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1603, in _getHaInfo > stats = instance.get_all_stats() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 100, in get_all_stats > stats = broker.get_stats_from_storage(service) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 229, in get_stats_from_storage > result = self._checked_communicate(request) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 257, in _checked_communicate > .format(message or response)) >RequestError: Request failed: <type 'exceptions.OSError'> >Thread-35::DEBUG::2014-06-04 11:49:48,540::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'DEVICE': 'eth0', 'HWADDR': 'a4:5d:36:11:e1:cc', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'ovirtmgmt'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '3100.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '10.34.63.104'}} >Thread-38::DEBUG::2014-06-04 11:49:48,561::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-38::DEBUG::2014-06-04 11:49:48,561::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-28::DEBUG::2014-06-04 11:49:53,797::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:49:53,803::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102701 s, 4.0 MB/s\n'; <rc> = 0 >Thread-39::DEBUG::2014-06-04 11:49:58,503::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call getCapabilities with () {} >Thread-39::DEBUG::2014-06-04 11:49:58,504::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-40::DEBUG::2014-06-04 11:49:58,510::task::595::TaskManager.Task::(_updateState) Task=`63623865-4f46-4f3a-b3d9-9760261917ad`::moving from state init -> state preparing >Thread-39::DEBUG::2014-06-04 11:49:58,511::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-40::INFO::2014-06-04 11:49:58,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-41::DEBUG::2014-06-04 11:49:58,512::BindingXMLRPC::1067::vds::(wrapper) client [10.34.63.104]::call vmGetStats with ('8adf82c9-1900-4fd9-8ba4-d73b55146b5b',) {} >Thread-40::INFO::2014-06-04 11:49:58,514::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102701', 'lastCheck': '4.7', 'valid': True}} >Thread-41::DEBUG::2014-06-04 11:49:58,514::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-40::DEBUG::2014-06-04 11:49:58,515::task::1185::TaskManager.Task::(prepare) Task=`63623865-4f46-4f3a-b3d9-9760261917ad`::finished: {'831ef374-8947-47f2-938f-5ec938f4fcef': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102701', 'lastCheck': '4.7', 'valid': True}} >Thread-40::DEBUG::2014-06-04 11:49:58,515::task::595::TaskManager.Task::(_updateState) Task=`63623865-4f46-4f3a-b3d9-9760261917ad`::moving from state preparing -> state finished >Thread-40::DEBUG::2014-06-04 11:49:58,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2014-06-04 11:49:58,516::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2014-06-04 11:49:58,516::task::990::TaskManager.Task::(_decref) Task=`63623865-4f46-4f3a-b3d9-9760261917ad`::ref 0 aborting False >Thread-40::ERROR::2014-06-04 11:49:58,523::API::1612::vds::(_getHaInfo) failed to retrieve Hosted Engine HA info >Traceback (most recent call last): > File "/usr/share/vdsm/API.py", line 1603, in _getHaInfo > stats = instance.get_all_stats() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/client/client.py", line 100, in get_all_stats > stats = broker.get_stats_from_storage(service) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 229, in get_stats_from_storage > result = self._checked_communicate(request) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 257, in _checked_communicate > .format(message or response)) >RequestError: Request failed: <type 'exceptions.OSError'> >Thread-39::DEBUG::2014-06-04 11:49:58,544::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1385086509.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1386756528L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1395806448L, 'version': '4.14.6'}, 'qemu-kvm': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.8', 'buildtime': 1401209234L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.8', 'buildtime': 1398190363L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1391183641L, 'version': '0.4.0'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.34.63.104', 'cfg': {'DEFROUTE': 'yes', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.34.63.254', 'ports': ['eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '30303734-3536-5A43-3133-343330305658', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cd', 'cfg': {'UUID': '4ac72639-6df6-493f-a1fd-b36b74f241fa', 'NM_CONTROLLED': 'yes', 'HWADDR': 'A4:5D:36:11:E1:CD', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'a4:5d:36:11:e1:cc', 'cfg': {'DEVICE': 'eth0', 'HWADDR': 'a4:5d:36:11:e1:cc', 'ONBOOT': 'yes', 'NM_CONTROLLED': 'no', 'BRIDGE': 'ovirtmgmt'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,lahf_lm,ida,arat,epb,xsaveopt,pln,pts,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,smep,erms,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:453979c6bd25', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '15782', 'cpuSpeed': '3100.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '4', 'kvmEnabled': 'true', 'guestOverhead': '65', 'management_ip': '0.0.0.0', 'cpuThreads': '4', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '5.el6.centos.11.1', 'version': '6', 'name': 'RHEL'}, 'lastClient': '10.34.63.104'}} >Thread-28::DEBUG::2014-06-04 11:50:03,808::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:50:03,815::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107026 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:50:13,823::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:50:13,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103192 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:50:23,832::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:50:23,838::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104813 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:50:33,842::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:50:33,854::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999763 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:50:43,858::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:50:43,864::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010292 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:50:53,868::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:50:53,874::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105411 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:51:03,878::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:51:03,884::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100576 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:51:13,887::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:51:13,893::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102231 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:51:23,897::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:51:23,903::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000992599 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:51:33,906::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:51:33,912::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100615 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:51:43,916::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:51:43,922::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010173 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:51:53,925::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:51:53,931::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990094 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:52:03,935::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:52:03,941::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102484 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:52:13,945::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:52:13,951::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100471 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:52:23,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:52:23,960::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100959 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:52:33,964::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:52:33,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102129 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:52:43,973::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:52:43,979::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107914 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:52:53,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:52:53,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110522 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:53:03,992::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:53:03,998::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107468 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:53:14,001::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:53:14,007::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108376 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:53:24,011::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:53:24,017::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105124 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:53:34,020::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:53:34,026::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105391 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:53:44,030::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:53:44,036::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105759 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:53:54,039::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:53:54,045::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107523 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:04,049::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:04,055::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105876 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:14,058::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:14,064::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010532 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:24,068::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:24,074::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102998 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:34,076::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 11:54:34,076::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:54:34,077::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:34,082::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000859686 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:34,082::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000859686 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 11:54:34,083::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 11:54:34,083::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 11:54:34,083::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:54:34,083::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:54:34,083::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:54:34,083::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:54:34,083::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:54:34,084::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:54:34,084::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:34,229::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:34,230::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:54:34,230::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 11:54:34,231::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 11:54:34,231::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 11:54:34,231::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 11:54:34,232::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:34,337::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:34,339::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:34,345::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000955307 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:44,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:44,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106822 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:54:54,358::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:54:54,364::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102528 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:55:04,367::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:55:04,373::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107342 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:55:14,377::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:55:14,383::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00123567 s, 3.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:55:24,386::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:55:24,392::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101776 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:55:34,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:55:34,402::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107965 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:55:44,405::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:55:44,411::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102516 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:55:54,415::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:55:54,421::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108385 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:56:04,424::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:56:04,430::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00093614 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:56:14,434::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:56:14,440::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109234 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:56:24,443::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:56:24,449::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000966258 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:56:34,453::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:56:34,459::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109098 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:56:44,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:56:44,468::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101132 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:56:54,472::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:56:54,478::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104148 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:57:04,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:57:04,487::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982674 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:57:14,491::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:57:14,497::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010395 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:57:24,501::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:57:24,506::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101244 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:57:34,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:57:34,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990841 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:57:44,520::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:57:44,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101761 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:57:54,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:57:54,535::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997873 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:58:04,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:58:04,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100259 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:58:14,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:58:14,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103037 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:58:24,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:58:24,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011004 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:58:34,568::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:58:34,576::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000948307 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:58:44,579::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:58:44,585::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107741 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:58:54,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:58:54,595::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107528 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:04,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:04,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106273 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:14,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:14,614::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107324 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:24,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:24,623::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110078 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:34,625::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 11:59:34,626::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:59:34,627::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:34,632::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000878788 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:34,632::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000878788 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 11:59:34,632::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 11:59:34,632::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 11:59:34,632::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 11:59:34,633::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:59:34,639::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:59:34,639::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:59:34,639::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:59:34,639::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 11:59:34,640::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:34,764::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:34,765::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 11:59:34,766::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 11:59:34,766::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 11:59:34,766::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 11:59:34,766::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 11:59:34,767::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:34,873::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:34,874::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:34,880::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100439 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:44,884::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:44,890::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109758 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 11:59:54,894::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 11:59:54,900::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108099 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:00:04,903::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:00:04,909::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107801 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:00:14,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:00:14,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106375 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:00:24,922::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:00:24,928::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103361 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:00:34,932::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:00:34,938::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107635 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:00:44,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:00:44,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000962158 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:00:54,951::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:00:54,957::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100856 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:01:04,960::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:01:04,968::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105337 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:01:14,971::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:01:14,977::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000987748 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:01:24,981::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:01:24,987::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109353 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:01:34,990::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:01:34,996::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000893892 s, 4.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:01:45,000::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:01:45,006::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110014 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:01:55,009::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:01:55,015::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000975202 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:02:05,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:02:05,025::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110383 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:02:15,028::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:02:15,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100787 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:02:25,038::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:02:25,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109894 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:02:35,047::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:02:35,053::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010048 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:02:45,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:02:45,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110013 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:02:55,066::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:02:55,072::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979699 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:03:05,076::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:03:05,082::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110395 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:03:15,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:03:15,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000936689 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:03:25,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:03:25,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108858 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:03:35,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:03:35,110::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100019 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:03:45,114::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:03:45,120::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100266 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:03:55,123::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:03:55,129::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100468 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:05,133::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:05,139::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979733 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:15,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:15,148::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010085 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:25,152::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:25,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106452 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:35,160::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:04:35,160::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:04:35,161::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:35,166::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000897811 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:35,166::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000897811 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:04:35,166::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:04:35,167::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:04:35,167::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:04:35,167::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:04:35,167::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:04:35,167::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:04:35,167::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:04:35,167::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:04:35,168::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:35,286::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:35,287::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:04:35,288::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:04:35,288::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:04:35,288::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:04:35,288::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:04:35,289::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:35,395::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:35,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:35,402::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000952264 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:45,406::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:45,412::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109491 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:04:55,415::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:04:55,421::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111997 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:05:05,425::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:05:05,431::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107801 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:05:15,434::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:05:15,440::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107331 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:05:25,444::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:05:25,450::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108188 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:05:35,453::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:05:35,459::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108462 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:05:45,463::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:05:45,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102027 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:05:55,472::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:05:55,478::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110485 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:06:05,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:06:05,488::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101395 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:06:15,491::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:06:15,497::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107869 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:06:25,501::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:06:25,507::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010132 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:06:35,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:06:35,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103626 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:06:45,520::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:06:45,525::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106533 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:06:55,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:06:55,535::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103091 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:07:05,538::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:07:05,544::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994556 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:07:15,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:07:15,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011172 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:07:25,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:07:25,563::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100956 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:07:35,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:07:35,573::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113614 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:07:45,576::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:07:45,582::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115857 s, 3.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:07:55,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:07:55,592::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103117 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:08:05,596::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:08:05,601::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102442 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:08:15,605::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:08:15,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102515 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:08:25,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:08:25,620::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000959261 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:08:35,624::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:08:35,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000969654 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:08:45,634::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:08:45,639::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000974971 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:08:55,643::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:08:55,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100193 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:05,652::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:05,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101174 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:15,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:15,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996674 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:25,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:25,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101577 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:35,679::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:09:35,680::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:09:35,681::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:35,686::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000819492 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:35,686::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000819492 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:09:35,686::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:09:35,686::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:09:35,687::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:09:35,687::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:09:35,687::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:09:35,687::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:09:35,687::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:09:35,687::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:09:35,688::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:35,796::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:35,797::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:09:35,797::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:09:35,797::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:09:35,798::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:09:35,798::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:09:35,798::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:35,906::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:35,908::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:35,914::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977326 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:45,917::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:45,923::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100362 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:09:55,927::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:09:55,933::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102541 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:10:05,936::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:10:05,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107637 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:10:15,946::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:10:15,952::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993336 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:10:25,955::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:10:25,961::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010352 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:10:35,965::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:10:35,971::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102453 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:10:45,974::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:10:45,980::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000991047 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:10:55,984::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:10:55,990::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101866 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:11:05,993::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:11:05,999::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000951332 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:11:16,003::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:11:16,008::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101859 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:11:26,012::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:11:26,018::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108556 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:11:36,022::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:11:36,027::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105027 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:11:46,031::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:11:46,037::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997794 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:11:56,041::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:11:56,046::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101866 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:12:06,050::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:12:06,056::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990717 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:12:16,060::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:12:16,065::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990679 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:12:26,069::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:12:26,075::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102976 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:12:36,078::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:12:36,084::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989018 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:12:46,088::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:12:46,094::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989786 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:12:56,097::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:12:56,103::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100663 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:13:06,107::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:13:06,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103495 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:13:16,116::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:13:16,122::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101818 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:13:26,126::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:13:26,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109438 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:13:36,135::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:13:36,141::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100993 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:13:46,145::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:13:46,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109993 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:13:56,154::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:13:56,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100018 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:06,164::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:06,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110687 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:16,173::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:16,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103233 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:26,183::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:26,189::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:36,191::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:14:36,191::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:14:36,193::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:36,197::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000798721 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:36,198::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000798721 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:14:36,198::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:14:36,198::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:14:36,198::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:14:36,198::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:14:36,198::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:14:36,199::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:14:36,199::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:14:36,199::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:14:36,199::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:36,307::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:36,308::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:14:36,308::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:14:36,309::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:14:36,309::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:14:36,309::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:14:36,309::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:36,416::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:36,418::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:36,424::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000893094 s, 4.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:46,428::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:46,434::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110509 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:14:56,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:14:56,443::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105262 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:15:06,447::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:15:06,453::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108625 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:15:16,456::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:15:16,462::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105775 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:15:26,466::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:15:26,472::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105965 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:15:36,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:15:36,481::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104883 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:15:46,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:15:46,491::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103556 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:15:56,495::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:15:56,500::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00096002 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:16:06,504::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:16:06,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105355 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:16:16,513::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:16:16,519::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990263 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:16:26,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:16:26,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102065 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:16:36,532::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:16:36,538::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000968835 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:16:46,542::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:16:46,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100483 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:16:56,551::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:16:56,557::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990603 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:17:06,561::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:17:06,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109152 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:17:16,570::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:17:16,576::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108166 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:17:26,580::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:17:26,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108855 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:17:36,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:17:36,595::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111206 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:17:46,599::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:17:46,605::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104145 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:17:56,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:17:56,614::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111613 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:18:06,618::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:18:06,624::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106019 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:18:16,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:18:16,633::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111387 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:18:26,637::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:18:26,643::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103319 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:18:36,646::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:18:36,652::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108701 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:18:46,656::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:18:46,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115604 s, 3.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:18:56,665::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:18:56,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106581 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:06,675::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:06,681::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108066 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:16,684::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:16,690::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106045 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:26,694::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:26,700::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106805 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:36,702::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:19:36,702::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:19:36,704::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:36,708::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000817668 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:36,709::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000817668 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:19:36,709::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:19:36,709::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:19:36,709::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:19:36,709::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:19:36,709::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:19:36,710::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:19:36,710::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:19:36,710::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:19:36,710::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:36,819::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:36,820::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:19:36,820::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:19:36,821::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:19:36,821::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:19:36,821::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:19:36,821::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:36,928::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:36,929::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:36,935::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000957789 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:46,939::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:46,945::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107748 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:19:56,948::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:19:56,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103309 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:20:06,958::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:20:06,964::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102745 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:20:16,967::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:20:16,973::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110157 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:20:26,977::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:20:26,983::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101551 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:20:36,986::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:20:36,992::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107934 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:20:46,996::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:20:47,002::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000984415 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:20:57,005::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:20:57,011::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108783 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:21:07,015::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:21:07,020::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103483 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:21:17,024::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:21:17,030::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108098 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:21:27,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:21:27,039::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103506 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:21:37,043::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:21:37,049::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108482 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:21:47,053::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:21:47,058::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101399 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:21:57,062::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:21:57,068::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107788 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:22:07,072::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:22:07,077::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000970909 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:22:17,081::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:22:17,087::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010344 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:22:27,090::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:22:27,096::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010139 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:22:37,100::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:22:37,106::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0009927 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:22:47,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:22:47,115::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100318 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:22:57,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:22:57,138::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0142428 s, 288 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:23:07,141::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:23:07,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010498 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:23:17,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:23:17,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010698 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:23:27,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:23:27,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109725 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:23:37,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:23:37,175::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102455 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:23:47,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:23:47,185::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109452 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:23:57,188::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:23:57,194::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010824 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:07,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:07,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110468 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:17,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:17,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010582 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:27,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:27,222::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101112 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:37,224::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:24:37,225::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:24:37,226::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:37,231::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000880378 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:37,231::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000880378 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:24:37,231::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:24:37,231::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:24:37,232::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:24:37,232::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:24:37,232::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:24:37,232::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:24:37,232::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:24:37,232::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:24:37,233::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:37,339::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:37,341::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:24:37,341::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:24:37,341::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:24:37,341::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:24:37,342::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:24:37,342::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:37,448::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:37,450::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:37,456::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000950428 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:47,460::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:47,466::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010417 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:24:57,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:24:57,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010362 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:25:07,479::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:25:07,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109838 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:25:17,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:25:17,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105788 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:25:27,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:25:27,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110536 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:25:37,542::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:25:37,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105766 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:25:47,552::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:25:47,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106263 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:25:57,561::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:25:57,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106328 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:26:07,570::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:26:07,576::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101417 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:26:17,580::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:26:17,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000975996 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:26:27,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:26:27,595::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110398 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:26:37,599::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:26:37,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100898 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:26:47,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:26:47,614::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111178 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:26:57,618::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:26:57,623::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988556 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:27:07,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:27:07,633::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111064 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:27:17,637::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:27:17,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999052 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:27:27,646::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:27:27,652::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110184 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:27:37,655::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:27:37,661::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100421 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:27:47,665::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:27:47,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108864 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:27:57,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:27:57,680::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999925 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:28:07,684::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:28:07,690::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112886 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:28:17,693::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:28:17,699::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994458 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:28:27,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:28:27,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114496 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:28:37,712::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:28:37,718::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102115 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:28:47,722::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:28:47,728::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010025 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:28:57,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:28:57,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101794 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:07,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:07,747::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010729 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:17,750::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:17,756::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104678 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:27,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:27,765::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107581 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:37,767::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:29:37,768::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:29:37,769::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:37,774::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000922681 s, 2.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:37,774::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000922681 s, 2.2 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:29:37,775::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:29:37,775::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:29:37,775::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:29:37,775::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:29:37,775::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:29:37,775::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:29:37,776::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:29:37,776::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:29:37,776::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:37,883::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:37,885::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:29:37,885::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:29:37,885::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:29:37,885::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:29:37,886::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:29:37,886::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:37,993::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:37,995::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:38,001::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000976141 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:48,004::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:48,010::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104837 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:29:58,014::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:29:58,020::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104251 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:30:08,023::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:30:08,029::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102264 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:30:18,033::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:30:18,039::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110396 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:30:28,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:30:28,048::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010025 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:30:38,052::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:30:38,058::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109475 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:30:48,061::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:30:48,067::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997479 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:30:58,071::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:30:58,077::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109398 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:31:08,080::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:31:08,086::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997209 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:31:18,090::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:31:18,096::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110352 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:31:28,099::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:31:28,105::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100582 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:31:38,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:31:38,115::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109262 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:31:48,118::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:31:48,124::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098545 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:31:58,128::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:31:58,134::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109784 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:32:08,138::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:32:08,143::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102287 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:32:18,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:32:18,153::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111819 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:32:28,156::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:32:28,162::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100567 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:32:38,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:32:38,172::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109351 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:32:48,175::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:32:48,181::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100513 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:32:58,185::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:32:58,190::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109853 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:33:08,194::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:33:08,200::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102547 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:33:18,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:33:18,209::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104955 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:33:28,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:33:28,218::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102233 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:33:38,222::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:33:38,228::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000940099 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:33:48,232::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:33:48,237::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010034 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:33:58,241::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:33:58,247::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102061 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:08,250::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:08,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098783 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:18,260::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:18,265::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100428 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:28,269::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:28,275::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100378 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:38,277::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:34:38,277::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:34:38,279::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:38,284::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000828823 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:38,284::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000828823 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:34:38,284::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:34:38,284::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:34:38,284::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:34:38,284::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:34:38,285::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:34:38,285::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:34:38,285::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:34:38,285::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:34:38,285::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:38,392::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:38,393::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:34:38,393::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:34:38,394::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:34:38,394::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:34:38,394::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:34:38,395::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:38,504::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:38,506::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:38,511::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000958437 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:48,515::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:48,521::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107582 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:34:58,524::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:34:58,530::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106421 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:35:08,534::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:35:08,540::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010833 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:35:18,543::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:35:18,549::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100442 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:35:28,553::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:35:28,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101594 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:35:38,562::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:35:38,568::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101395 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:35:48,571::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:35:48,577::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104207 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:35:58,581::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:35:58,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000965787 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:36:08,590::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:36:08,596::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104481 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:36:18,599::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:36:18,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0543409 s, 75.4 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:36:28,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:36:28,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102495 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:36:38,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:36:38,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100396 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:36:48,680::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:36:48,686::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100454 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:36:58,690::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:36:58,696::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101351 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:37:08,699::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:37:08,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107495 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:37:18,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:37:18,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098602 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:37:28,718::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:37:28,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106873 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:37:38,727::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:37:38,733::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000976637 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:37:48,737::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:37:48,742::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010485 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:37:58,746::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:37:58,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994275 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:38:08,756::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:38:08,761::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000986572 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:38:18,765::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:38:18,771::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100961 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:38:28,774::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:38:28,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000968868 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:38:38,784::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:38:38,789::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100337 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:38:48,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:38:48,799::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104153 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:38:58,802::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:38:58,808::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101148 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:08,812::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:08,817::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103842 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:18,821::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:18,827::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109224 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:28,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:28,836::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104609 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:38,839::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:39:38,839::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:39:38,840::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:38,845::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000853101 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:38,845::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000853101 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:39:38,845::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:39:38,845::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:39:38,846::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:39:38,846::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:39:38,846::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:39:38,846::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:39:38,846::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:39:38,846::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:39:38,847::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:38,954::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:38,955::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:39:38,955::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:39:38,956::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:39:38,956::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:39:38,956::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:39:38,956::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:39,063::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:39,065::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:39,071::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000963341 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:49,075::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:49,080::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109446 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:39:59,084::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:39:59,090::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000983158 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:40:09,094::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:40:09,100::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109311 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:40:19,103::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:40:19,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000947689 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:40:29,113::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:40:29,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107466 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:40:39,122::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:40:39,128::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101139 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:40:49,131::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:40:49,137::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108263 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:40:59,141::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:40:59,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100919 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:41:09,150::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:41:09,156::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104952 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:41:19,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:41:19,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106984 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:41:29,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:41:29,175::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105148 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:41:39,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:41:39,185::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001044 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:41:49,188::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:41:49,194::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989527 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:41:59,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:41:59,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977522 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:42:09,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:42:09,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0009643 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:42:19,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:42:19,222::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000962432 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:42:29,226::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:42:29,232::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101274 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:42:39,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:42:39,241::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107309 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:42:49,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:42:49,251::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101044 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:42:59,255::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:42:59,260::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105784 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:43:09,264::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:43:09,270::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103093 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:43:19,273::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:43:19,279::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103792 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:43:29,283::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:43:29,289::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102344 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:43:39,292::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:43:39,298::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102809 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:43:49,301::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:43:49,307::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105387 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:43:59,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:43:59,317::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110747 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:09,320::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:09,326::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104556 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:19,330::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:19,336::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109446 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:29,340::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:29,346::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998057 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:39,348::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:44:39,349::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:44:39,350::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:39,355::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000889396 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:39,355::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000889396 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:44:39,355::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:44:39,355::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:44:39,355::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:44:39,356::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:44:39,356::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:44:39,356::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:44:39,356::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:44:39,356::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:44:39,357::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:39,463::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:39,464::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:44:39,464::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:44:39,465::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:44:39,465::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:44:39,465::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:44:39,466::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:39,571::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:39,573::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:39,579::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000961896 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:49,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:49,588::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000980453 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:44:59,592::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:44:59,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104076 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:45:09,602::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:45:09,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113431 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:45:19,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:45:19,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010559 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:45:29,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:45:29,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010839 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:45:39,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:45:39,636::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107449 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:45:49,640::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:45:49,645::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109944 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:45:59,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:45:59,655::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108147 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:46:09,659::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:46:09,665::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108474 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:46:19,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:46:19,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109089 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:46:29,678::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:46:29,684::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109562 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:46:39,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:46:39,693::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109098 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:46:49,696::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:46:49,702::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106414 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:46:59,706::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:46:59,712::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112614 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:47:09,715::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:47:09,721::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000959659 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:47:19,725::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:47:19,731::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011083 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:47:29,734::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:47:29,740::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000975746 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:47:39,744::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:47:39,749::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110593 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:47:49,753::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:47:49,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100087 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:47:59,763::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:47:59,769::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110958 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:48:09,772::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:48:09,778::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101466 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:48:19,782::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:48:19,788::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000968225 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:48:29,791::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:48:29,797::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997422 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:48:39,801::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:48:39,806::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108467 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:48:49,810::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:48:49,816::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107038 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:48:59,820::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:48:59,826::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107426 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:09,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:09,835::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107165 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:19,839::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:19,845::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108799 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:29,849::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:29,854::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114605 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:39,857::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:49:39,857::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:49:39,858::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:39,863::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000911835 s, 2.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:39,863::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000911835 s, 2.2 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:49:39,864::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:49:39,864::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:49:39,864::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:49:39,864::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:49:39,864::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:49:39,864::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:49:39,864::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:49:39,865::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:49:39,865::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:39,973::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:39,974::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:49:39,975::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:49:39,975::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:49:39,975::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:49:39,975::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:49:39,976::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:40,083::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:40,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:40,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989193 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:49:50,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:49:50,100::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114214 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:50:00,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:50:00,110::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011101 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:50:10,114::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:50:10,120::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108722 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:50:20,123::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:50:20,129::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108849 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:50:30,133::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:50:30,139::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115875 s, 3.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:50:40,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:50:40,148::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000950438 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:50:50,152::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:50:50,158::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106704 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:51:00,162::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:51:00,167::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102436 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:51:10,171::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:51:10,177::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101196 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:51:20,181::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:51:20,187::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000965864 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:51:30,191::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:51:30,196::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104645 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:51:40,200::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:51:40,206::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000932007 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:51:50,209::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:51:50,215::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106068 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:52:00,219::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:52:00,225::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104232 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:52:10,228::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:52:10,234::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109464 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:52:20,238::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:52:20,244::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101634 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:52:30,247::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:52:30,253::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105471 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:52:40,257::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:52:40,262::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989119 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:52:50,266::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:52:50,272::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000943062 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:53:00,276::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:53:00,282::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103406 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:53:10,286::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:53:10,292::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106112 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:53:20,296::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:53:20,301::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102396 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:53:30,305::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:53:30,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103073 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:53:40,315::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:53:40,320::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101491 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:53:50,324::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:53:50,330::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102184 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:00,334::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:00,340::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100271 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:10,344::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:10,350::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000991258 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:20,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:20,359::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101191 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:30,363::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:30,369::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102601 s, 4.0 MB/s\n'; <rc> = 0 >Thread-42::DEBUG::2014-06-04 12:54:36,381::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-42::ERROR::2014-06-04 12:54:36,382::BindingXMLRPC::256::vds::(wrapper) Unexpected exception >Traceback (most recent call last): > File "/usr/share/vdsm/BindingXMLRPC.py", line 254, in wrapper > return f(*args, **kwargs) >TypeError: volumePrepare() takes at least 5 arguments (1 given) >Thread-28::DEBUG::2014-06-04 12:54:40,371::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:54:40,372::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:54:40,373::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:40,378::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000885914 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:40,378::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000885914 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:54:40,378::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:54:40,378::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:54:40,378::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:54:40,379::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:54:40,379::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:54:40,379::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:54:40,379::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:54:40,379::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:54:40,380::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:40,496::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:40,497::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:54:40,498::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:54:40,498::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:54:40,498::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:54:40,498::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:54:40,499::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:40,609::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:40,612::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:40,618::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000956236 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:54:50,622::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:54:50,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104788 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:55:00,631::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:55:00,637::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109668 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:55:10,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:55:10,647::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101067 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:55:20,650::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:55:20,656::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106385 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:55:30,660::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:55:30,666::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101116 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:55:40,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:55:40,675::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990299 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:55:50,679::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:55:50,685::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000975508 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:56:00,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:56:00,694::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106845 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:56:10,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:56:10,704::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000981207 s, 4.2 MB/s\n'; <rc> = 0 >Thread-43::DEBUG::2014-06-04 12:56:16,399::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-43::DEBUG::2014-06-04 12:56:16,400::task::595::TaskManager.Task::(_updateState) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::moving from state init -> state preparing >Thread-43::INFO::2014-06-04 12:56:16,400::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-43::DEBUG::2014-06-04 12:56:16,400::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`20514def-40c7-49a2-805d-3de2b999e076`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-43::DEBUG::2014-06-04 12:56:16,400::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-43::DEBUG::2014-06-04 12:56:16,401::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-06-04 12:56:16,401::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`20514def-40c7-49a2-805d-3de2b999e076`::Granted request >Thread-43::DEBUG::2014-06-04 12:56:16,401::task::827::TaskManager.Task::(resourceAcquired) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-43::DEBUG::2014-06-04 12:56:16,401::task::990::TaskManager.Task::(_decref) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::ref 1 aborting False >Thread-43::DEBUG::2014-06-04 12:56:16,401::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`10c616c9-57b3-414c-952b-6cc5a6723cac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-43::DEBUG::2014-06-04 12:56:16,401::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-43::DEBUG::2014-06-04 12:56:16,402::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-43::DEBUG::2014-06-04 12:56:16,402::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-43::DEBUG::2014-06-04 12:56:16,511::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-43::DEBUG::2014-06-04 12:56:16,515::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-43::DEBUG::2014-06-04 12:56:16,516::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-43::ERROR::2014-06-04 12:56:16,516::blockVolume::421::Storage.Volume::(validateImagePath) Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/blockVolume.py", line 419, in validateImagePath > os.mkdir(imageDir, 0o755) >OSError: [Errno 2] No such file or directory: '/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd' >Thread-43::WARNING::2014-06-04 12:56:16,517::resourceManager::591::ResourceManager::(registerResource) Resource factory failed to create resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd'. Canceling request. >Traceback (most recent call last): > File "/usr/share/vdsm/storage/resourceManager.py", line 587, in registerResource > obj = namespaceObj.factory.createResource(name, lockType) > File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in createResource > lockType) > File "/usr/share/vdsm/storage/resourceFactories.py", line 122, in __getResourceCandidatesList > imgUUID=resourceName) > File "/usr/share/vdsm/storage/image.py", line 187, in getChain > srcVol = volclass(self.repoPath, sdUUID, imgUUID, uuidlist[0]) > File "/usr/share/vdsm/storage/blockVolume.py", line 80, in __init__ > volume.Volume.__init__(self, repoPath, sdUUID, imgUUID, volUUID) > File "/usr/share/vdsm/storage/volume.py", line 140, in __init__ > self.validate() > File "/usr/share/vdsm/storage/blockVolume.py", line 89, in validate > volume.Volume.validate(self) > File "/usr/share/vdsm/storage/volume.py", line 152, in validate > self.validateImagePath() > File "/usr/share/vdsm/storage/blockVolume.py", line 422, in validateImagePath > raise se.ImagePathError(imageDir) >ImagePathError: Image path does not exist or cannot be accessed/created: ('/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd',) >Thread-43::DEBUG::2014-06-04 12:56:16,518::resourceManager::210::ResourceManager.Request::(cancel) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`10c616c9-57b3-414c-952b-6cc5a6723cac`::Canceled request >Thread-43::WARNING::2014-06-04 12:56:16,518::resourceManager::203::ResourceManager.Request::(cancel) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`10c616c9-57b3-414c-952b-6cc5a6723cac`::Tried to cancel a processed request >Thread-43::ERROR::2014-06-04 12:56:16,519::task::866::TaskManager.Task::(_setError) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3171, in prepareVolume > imgUUID, lockType, timeout) > File "/usr/share/vdsm/storage/resourceManager.py", line 523, in acquireResource > raise se.ResourceAcqusitionFailed() >ResourceAcqusitionFailed: Could not acquire resource. Probably resource factory threw an exception.: () >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::885::TaskManager.Task::(_run) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::Task._run: ee246515-86f1-4415-9ccd-796bef7d5688 ('831ef374-8947-47f2-938f-5ec938f4fcef', '32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', True) {} failed - stopping task >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::1211::TaskManager.Task::(stop) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::stopping in state preparing (force False) >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::990::TaskManager.Task::(_decref) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::ref 1 aborting True >Thread-43::INFO::2014-06-04 12:56:16,520::task::1168::TaskManager.Task::(prepare) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::aborting: Task is aborted: u'Could not acquire resource. Probably resource factory threw an exception.: ()' - code 100 >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::1173::TaskManager.Task::(prepare) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::Prepare: aborted: Could not acquire resource. Probably resource factory threw an exception.: () >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::990::TaskManager.Task::(_decref) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::ref 0 aborting True >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::925::TaskManager.Task::(_doAbort) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::Task._doAbort: force False >Thread-43::DEBUG::2014-06-04 12:56:16,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-06-04 12:56:16,520::task::595::TaskManager.Task::(_updateState) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::moving from state preparing -> state aborting >Thread-43::DEBUG::2014-06-04 12:56:16,521::task::550::TaskManager.Task::(__state_aborting) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::_aborting: recover policy none >Thread-43::DEBUG::2014-06-04 12:56:16,521::task::595::TaskManager.Task::(_updateState) Task=`ee246515-86f1-4415-9ccd-796bef7d5688`::moving from state aborting -> state failed >Thread-43::DEBUG::2014-06-04 12:56:16,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-06-04 12:56:16,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-06-04 12:56:16,521::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-43::DEBUG::2014-06-04 12:56:16,521::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-43::DEBUG::2014-06-04 12:56:16,521::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-06-04 12:56:16,521::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-43::ERROR::2014-06-04 12:56:16,522::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': 'Could not acquire resource. Probably resource factory threw an exception.: ()', 'code': 855}} >Thread-28::DEBUG::2014-06-04 12:56:20,708::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:56:20,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107345 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:56:30,718::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:56:30,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101821 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:56:40,732::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:56:40,738::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106278 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:56:50,746::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:56:50,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000960804 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:57:00,756::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:57:00,762::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106089 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:57:10,766::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:57:10,771::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101967 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:57:20,775::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:57:20,781::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105238 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:57:30,785::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:57:30,790::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101186 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:57:40,794::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:57:40,800::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109426 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:57:50,804::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:57:50,809::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101754 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:58:00,813::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:58:00,819::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101855 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:58:10,823::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:58:10,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101392 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:58:20,832::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:58:20,838::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010553 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:58:30,842::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:58:30,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102155 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:58:40,852::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:58:40,858::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111568 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:58:50,861::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:58:50,867::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101882 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:00,871::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:00,877::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108605 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:10,881::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:10,886::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104121 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:20,890::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:20,896::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108131 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:30,900::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:30,906::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101631 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:40,908::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 12:59:40,908::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:59:40,910::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:40,915::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000827601 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:40,915::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000827601 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 12:59:40,915::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 12:59:40,915::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 12:59:40,915::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 12:59:40,915::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:59:40,922::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:59:40,922::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:59:40,922::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:59:40,922::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 12:59:40,923::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:41,075::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:41,076::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 12:59:41,076::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 12:59:41,077::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 12:59:41,077::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 12:59:41,077::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 12:59:41,077::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:41,185::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:41,187::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:41,193::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000963053 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 12:59:51,197::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 12:59:51,203::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102292 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:00:01,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:00:01,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000972475 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:00:11,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:00:11,223::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996317 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:00:21,227::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:00:21,233::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000978274 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:00:31,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:00:31,242::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979037 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:00:41,246::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:00:41,252::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102836 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:00:51,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:00:51,262::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108988 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:01:01,265::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:01:01,271::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000983585 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:01:11,275::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:01:11,281::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106718 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:01:21,291::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:01:21,296::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000962366 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:01:31,300::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:01:31,306::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102253 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:01:41,310::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:01:41,315::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102435 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:01:51,319::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:01:51,325::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103667 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:02:01,329::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:02:01,335::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106281 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:02:11,338::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:02:11,344::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102422 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:02:21,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:02:21,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100592 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:02:31,357::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:02:31,363::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105726 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:02:41,367::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:02:41,373::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101925 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:02:51,377::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:02:51,382::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105026 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:03:01,386::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:03:01,392::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100964 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:03:11,396::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:03:11,402::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108659 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:03:21,405::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:03:21,411::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000942682 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:03:31,415::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:03:31,421::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103562 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:03:41,424::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:03:41,430::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979001 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:03:51,434::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:03:51,440::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101499 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:01,443::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:01,449::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101505 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:11,453::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:11,459::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107475 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:21,463::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:21,468::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102536 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:31,472::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:31,478::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109657 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:41,480::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:04:41,480::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:04:41,482::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:41,487::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000877633 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:41,487::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000877633 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:04:41,487::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:04:41,487::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:04:41,487::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:04:41,488::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:04:41,488::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:04:41,488::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:04:41,488::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:04:41,488::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:04:41,489::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:41,609::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:41,610::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:04:41,610::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:04:41,611::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:04:41,611::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:04:41,611::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:04:41,612::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:41,718::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:41,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:41,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000951698 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:04:51,730::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:04:51,736::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109912 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:05:01,739::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:05:01,745::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106924 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:05:11,749::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:05:11,755::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109631 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:05:21,759::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:05:21,765::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112698 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:05:31,768::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:05:31,774::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107978 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:05:41,778::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:05:41,784::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108073 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:05:51,787::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:05:51,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107523 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:06:01,797::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:06:01,803::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106266 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:06:11,806::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:06:11,812::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105635 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:06:21,816::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:06:21,822::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102872 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:06:31,825::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:06:31,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010829 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:06:41,835::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:06:41,841::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108613 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:06:51,845::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:06:51,851::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104685 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:07:01,854::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:07:01,860::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109814 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:07:11,864::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:07:11,943::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0742904 s, 55.1 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:07:21,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:07:21,953::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105154 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:07:31,956::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:07:31,962::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101886 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:07:41,966::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:07:41,971::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101905 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:07:51,975::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:07:51,981::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101452 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:08:01,985::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:08:01,990::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000954616 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:08:11,994::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:08:12,000::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101531 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:08:22,004::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:08:22,009::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109202 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:08:32,013::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:08:32,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109575 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:08:42,023::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:08:42,028::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106909 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:08:52,032::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:08:52,038::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107744 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:02,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:02,048::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110307 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:12,051::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:12,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106383 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:22,061::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:22,067::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105242 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:32,071::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:32,076::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106927 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:42,079::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:09:42,079::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:09:42,081::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:42,086::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000912277 s, 2.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:42,086::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000912277 s, 2.2 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:09:42,086::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:09:42,086::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:09:42,086::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:09:42,086::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:09:42,087::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:09:42,087::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:09:42,087::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:09:42,087::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:09:42,087::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:42,195::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:42,196::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:09:42,196::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:09:42,197::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:09:42,197::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:09:42,197::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:09:42,197::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:42,304::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:42,306::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:42,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010252 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:09:52,315::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:09:52,321::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100006 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:10:02,325::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:10:02,331::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106724 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:10:12,335::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:10:12,341::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105945 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:10:22,372::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:10:22,378::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109709 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:10:32,382::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:10:32,388::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010695 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:10:42,392::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:10:42,398::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113542 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:10:52,401::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:10:52,407::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112076 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:11:02,411::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:11:02,417::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112057 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:11:12,421::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:11:12,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112655 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:11:22,431::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:11:22,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110018 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:11:32,441::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:11:32,446::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109425 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:11:42,450::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:11:42,456::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111251 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:11:52,460::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:11:52,466::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104607 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:12:02,470::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:12:02,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112384 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:12:12,479::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:12:12,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101859 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:12:22,489::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:12:22,494::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105758 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:12:32,498::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:12:32,504::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000981111 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:12:42,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:12:42,514::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106787 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:12:52,518::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:12:52,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101645 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:13:02,527::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:13:02,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100826 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:13:12,537::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:13:12,543::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994432 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:13:22,546::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:13:22,552::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989846 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:13:32,556::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:13:32,562::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104618 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:13:42,566::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:13:42,571::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105656 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:13:52,575::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:13:52,581::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103277 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:02,585::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:02,591::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108734 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:12,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:12,600::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103559 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:22,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:22,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100215 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:32,614::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:32,619::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109094 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:42,621::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:14:42,622::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:14:42,623::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:42,628::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000855661 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:42,628::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000855661 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:14:42,628::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:14:42,629::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:14:42,629::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:14:42,629::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:14:42,629::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:14:42,629::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:14:42,630::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:14:42,630::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:14:42,630::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:42,739::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:42,741::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:14:42,741::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:14:42,742::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:14:42,742::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:14:42,742::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:14:42,742::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:42,850::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:42,852::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:42,858::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000963446 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:14:52,862::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:14:52,867::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105282 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:15:02,871::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:15:02,877::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000972775 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:15:12,881::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:15:12,887::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107442 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:15:22,890::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:15:22,896::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104607 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:15:32,900::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:15:32,906::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108283 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:15:42,909::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:15:42,915::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000952045 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:15:52,919::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:15:52,925::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105082 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:16:02,929::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:16:02,935::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993474 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:16:12,939::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:16:12,945::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107347 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:16:22,948::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:16:22,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997646 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:16:32,958::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:16:32,964::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110357 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:16:42,968::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:16:42,973::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993715 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:16:52,977::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:16:52,983::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109319 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:17:02,987::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:17:02,992::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103072 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:17:12,996::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:17:13,002::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010434 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:17:23,006::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:17:23,011::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102194 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:17:33,015::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:17:33,021::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105733 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:17:43,025::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:17:43,031::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010122 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:17:53,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:17:53,040::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107409 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:18:03,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:18:03,050::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101312 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:18:13,054::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:18:13,059::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101056 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:18:23,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:18:23,069::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100675 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:18:33,073::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:18:33,078::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100311 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:18:43,082::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:18:43,088::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101428 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:18:53,092::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:18:53,097::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000975237 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:03,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:03,107::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100574 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:13,111::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:13,116::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979595 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:23,120::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:23,126::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103358 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:33,130::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:33,135::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982628 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:43,138::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:19:43,138::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:19:43,140::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:43,144::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00078824 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:43,144::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00078824 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:19:43,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:19:43,145::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:19:43,145::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:19:43,145::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:19:43,145::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:19:43,145::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:19:43,146::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:19:43,146::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:19:43,146::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:43,251::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:43,252::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:19:43,253::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:19:43,253::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:19:43,253::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:19:43,254::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:19:43,254::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:43,360::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:43,362::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:43,368::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098333 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:19:53,371::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:19:53,377::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00095622 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:20:03,381::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:20:03,387::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010116 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:20:13,391::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:20:13,397::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010122 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:20:23,400::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:20:23,406::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107028 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:20:33,410::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:20:33,416::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100846 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:20:43,420::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:20:43,425::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105269 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:20:53,429::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:20:53,435::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100642 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:21:03,439::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:21:03,444::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103061 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:21:13,448::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:21:13,454::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993179 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:21:23,458::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:21:23,463::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108033 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:21:33,467::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:21:33,473::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999481 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:21:43,478::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:21:43,483::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011006 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:21:53,488::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:21:53,493::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103509 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:22:03,497::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:22:03,503::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104657 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:22:13,507::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:22:13,513::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102813 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:22:23,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:22:23,522::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000953044 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:22:33,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:22:33,532::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102183 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:22:43,536::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:22:43,541::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106226 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:22:53,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:22:53,551::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010163 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:23:03,555::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:23:03,561::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102775 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:23:13,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:23:13,572::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000937381 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:23:23,575::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:23:23,581::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107985 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:23:33,585::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:23:33,591::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101778 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:23:43,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:23:43,600::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105191 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:23:53,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:23:53,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099484 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:03,613::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:03,619::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104564 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:13,623::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:13,629::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101673 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:23,632::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:23,638::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979703 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:33,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:33,648::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000991428 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:43,650::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:24:43,650::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:24:43,651::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:43,656::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00088125 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:43,657::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00088125 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:24:43,657::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:24:43,657::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:24:43,657::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:24:43,657::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:24:43,657::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:24:43,658::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:24:43,658::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:24:43,658::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:24:43,658::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:43,779::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:43,780::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:24:43,780::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:24:43,781::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:24:43,781::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:24:43,781::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:24:43,782::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:43,891::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:43,893::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:43,898::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000950451 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:24:53,902::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:24:53,908::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101495 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:25:03,912::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:25:03,918::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105821 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:25:13,922::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:25:13,928::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111795 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:25:23,932::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:25:23,937::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102608 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:25:33,941::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:25:33,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106748 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:25:43,951::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:25:43,956::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996112 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:25:53,963::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:25:53,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107872 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:26:03,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:26:03,978::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101953 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:26:13,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:26:13,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108919 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:26:23,991::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:26:23,997::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101788 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:26:34,001::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:26:34,007::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108628 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:26:44,010::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:26:44,016::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000995681 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:26:54,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:26:54,025::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106579 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:27:04,029::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:27:04,035::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100652 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:27:14,038::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:27:14,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107128 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:27:24,048::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:27:24,054::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010084 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:27:34,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:27:34,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105134 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:27:44,066::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:27:44,072::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000987259 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:27:54,076::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:27:54,082::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107953 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:28:04,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:28:04,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997284 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:28:14,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:28:14,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107896 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:28:24,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:28:24,110::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997245 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:28:34,113::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:28:34,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103017 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:28:44,123::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:28:44,129::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101414 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:28:54,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:28:54,138::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103966 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:04,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:04,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000970303 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:14,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:14,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108467 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:24,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:24,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000985721 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:34,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:34,176::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111769 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:44,178::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:29:44,178::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:29:44,180::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:44,184::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000784136 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:44,185::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000784136 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:29:44,185::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:29:44,185::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:29:44,185::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:29:44,185::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:29:44,185::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:29:44,185::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:29:44,186::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:29:44,186::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:29:44,186::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:44,293::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:44,294::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:29:44,294::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:29:44,295::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:29:44,295::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:29:44,295::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:29:44,295::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:44,402::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:44,404::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:44,410::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977031 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:29:54,413::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:29:54,419::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109826 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:30:04,423::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:30:04,429::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102758 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:30:14,432::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:30:14,438::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107769 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:30:24,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:30:24,448::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101655 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:30:34,451::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:30:34,457::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109417 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:30:44,461::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:30:44,467::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101126 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:30:54,470::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:30:54,476::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108041 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:31:04,480::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:31:04,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101354 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:31:14,489::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:31:14,495::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106029 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:31:24,499::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:31:24,504::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982409 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:31:34,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:31:34,514::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001102 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:31:44,517::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:31:44,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106122 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:31:54,527::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:31:54,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000985146 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:32:04,536::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:32:04,542::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111749 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:32:14,546::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:32:14,551::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102465 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:32:24,555::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:32:24,561::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110429 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:32:34,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:32:34,570::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100139 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:32:44,574::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:32:44,580::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010929 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:32:54,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:32:54,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100776 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:33:04,593::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:33:04,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112567 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:33:14,602::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:33:14,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101063 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:33:24,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:33:24,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105431 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:33:34,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:33:34,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101083 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:33:44,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:33:44,636::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100932 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:33:54,640::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:33:54,645::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102444 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:04,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:04,655::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107465 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:14,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:14,664::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993958 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:24,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:24,674::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105769 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:34,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:34,683::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101409 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:44,685::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:34:44,685::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:34:44,687::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:44,692::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000851586 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:44,692::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000851586 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:34:44,692::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:34:44,692::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:34:44,692::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:34:44,693::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:34:44,699::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:34:44,699::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:34:44,699::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:34:44,699::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:34:44,700::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:44,815::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:44,816::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:34:44,817::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:34:44,817::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:34:44,817::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:34:44,817::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:34:44,818::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:44,925::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:44,927::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:44,933::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998234 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:34:54,936::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:34:54,942::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00095421 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:35:04,946::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:35:04,952::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108122 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:35:14,955::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:35:14,961::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000945715 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:35:24,964::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:35:24,970::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00094145 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:35:34,974::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:35:34,979::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101723 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:35:44,983::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:35:44,989::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000977179 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:35:54,992::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:35:54,998::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982642 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:36:05,002::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:36:05,008::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000985073 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:36:15,011::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:36:15,017::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999289 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:36:25,021::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:36:25,027::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106506 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:36:35,030::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:36:35,036::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010114 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:36:45,040::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:36:45,046::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106251 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:36:55,049::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:36:55,055::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101446 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:37:05,059::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:37:05,064::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010477 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:37:15,068::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:37:15,074::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105718 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:37:25,078::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:37:25,084::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103251 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:37:35,087::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:37:35,093::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101514 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:37:45,097::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:37:45,102::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988027 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:37:55,106::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:37:55,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000966655 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:38:05,115::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:38:05,121::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101508 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:38:15,125::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:38:15,131::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104104 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:38:25,134::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:38:25,140::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100106 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:38:35,144::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:38:35,149::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104155 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:38:45,153::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:38:45,159::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010149 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:38:55,162::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:38:55,168::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103548 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:05,172::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:05,178::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101748 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:15,181::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:15,187::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103309 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:25,191::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:25,196::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102867 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:35,200::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:35,206::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102428 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:45,208::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:39:45,208::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:39:45,210::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:45,214::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000799418 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:45,215::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000799418 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:39:45,215::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:39:45,215::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:39:45,215::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:39:45,215::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:39:45,215::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:39:45,216::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:39:45,216::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:39:45,216::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:39:45,216::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:45,323::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:45,324::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:39:45,325::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:39:45,325::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:39:45,325::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:39:45,325::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:39:45,326::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:45,433::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:45,435::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:45,441::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000973167 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:39:55,444::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:39:55,450::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000975727 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:40:05,454::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:40:05,460::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999934 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:40:15,464::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:40:15,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000937072 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:40:25,473::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:40:25,479::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101958 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:40:35,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:40:35,488::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000972773 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:40:45,492::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:40:45,498::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101816 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:40:55,501::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:40:55,507::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103515 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:41:05,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:41:05,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105108 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:41:15,520::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:41:15,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110045 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:41:25,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:41:25,535::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108836 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:41:35,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:41:35,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110835 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:41:45,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:41:45,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106538 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:41:55,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:41:55,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108442 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:42:05,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:42:05,573::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001042 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:42:15,577::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:42:15,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106879 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:42:25,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:42:25,592::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010743 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:42:35,596::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:42:35,602::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107501 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:42:45,605::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:42:45,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104548 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:42:55,615::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:42:55,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108536 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:43:05,624::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:43:05,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100855 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:43:15,634::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:43:15,640::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106334 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:43:25,643::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:43:25,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103684 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:43:35,652::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:43:35,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00097665 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:43:45,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:43:45,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103203 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:43:55,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:43:55,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000965665 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:05,681::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:05,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103634 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:15,690::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:15,696::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998692 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:25,700::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:25,706::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010829 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:35,709::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:35,715::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100214 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:45,717::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:44:45,718::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:44:45,719::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:45,724::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00085828 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:45,724::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00085828 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:44:45,724::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:44:45,724::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:44:45,724::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:44:45,725::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:44:45,725::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:44:45,725::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:44:45,725::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:44:45,725::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:44:45,726::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:45,833::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:45,834::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:44:45,834::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:44:45,835::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:44:45,835::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:44:45,835::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:44:45,835::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:45,942::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:45,944::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:45,950::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000966964 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:44:55,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:44:55,959::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102054 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:45:05,963::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:45:05,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104076 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:45:15,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:45:15,978::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000995838 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:45:25,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:45:25,987::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000963106 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:45:35,991::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:45:35,997::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101315 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:45:46,000::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:45:46,006::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109083 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:45:56,010::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:45:56,015::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108586 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:46:06,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:46:06,025::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109232 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:46:16,029::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:46:16,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107365 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:46:26,038::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:46:26,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103601 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:46:36,047::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:46:36,053::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103922 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:46:46,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:46:46,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105882 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:46:56,066::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:46:56,072::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102447 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:47:06,076::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:47:06,081::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105667 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:47:16,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:47:16,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103291 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:47:26,094::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:47:26,100::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108707 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:47:36,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:47:36,110::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109445 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:47:46,113::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:47:46,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109603 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:47:56,123::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:47:56,128::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107527 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:48:06,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:48:06,138::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108072 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:48:16,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:48:16,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104877 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:48:26,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:48:26,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011037 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:48:36,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:48:36,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102104 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:48:46,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:48:46,176::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111211 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:48:56,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:48:56,185::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000973857 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:06,189::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:06,195::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111874 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:16,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:16,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100188 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:26,208::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:26,214::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111464 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:36,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:36,223::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102239 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:46,225::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:49:46,225::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:49:46,227::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:46,232::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000861244 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:46,232::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000861244 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:49:46,232::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:49:46,232::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:49:46,232::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:49:46,233::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:49:46,233::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:49:46,233::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:49:46,233::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:49:46,233::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:49:46,234::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:46,341::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:46,343::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:49:46,343::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:49:46,343::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:49:46,343::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:49:46,344::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:49:46,344::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:46,452::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:46,454::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:46,460::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000980755 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:49:56,463::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:49:56,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101352 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:50:06,473::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:50:06,479::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010444 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:50:16,482::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:50:16,488::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101796 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:50:26,491::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:50:26,497::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106804 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:50:36,501::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:50:36,507::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010703 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:50:46,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:50:46,516::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106663 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:50:56,520::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:50:56,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114574 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:51:06,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:51:06,535::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112227 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:51:16,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:51:16,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114407 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:51:26,548::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:51:26,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109917 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:51:36,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:51:36,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110713 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:51:46,567::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:51:46,573::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101884 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:51:56,577::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:51:56,582::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107298 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:52:06,586::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:52:06,592::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109827 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:52:16,595::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:52:16,601::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104226 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:52:26,605::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:52:26,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110339 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:52:36,614::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:52:36,620::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111446 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:52:46,624::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:52:46,629::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102821 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:52:56,633::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:52:56,639::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112863 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:53:06,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:53:06,648::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000958351 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:53:16,652::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:53:16,658::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113319 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:53:26,661::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:53:26,667::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100199 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:53:36,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:53:36,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105876 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:53:46,680::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:53:46,686::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101108 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:53:56,689::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:53:56,695::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113879 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:06,699::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:06,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010209 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:16,708::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:16,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104427 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:26,718::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:26,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100971 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:36,727::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:36,733::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010387 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:46,735::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:54:46,736::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:54:46,737::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:46,742::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00081542 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:46,742::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00081542 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:54:46,742::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:54:46,742::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:54:46,742::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:54:46,742::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:54:46,743::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:54:46,743::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:54:46,743::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:54:46,743::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:54:46,743::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:46,855::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:46,856::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:54:46,857::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:54:46,857::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:54:46,857::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:54:46,858::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:54:46,858::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:46,970::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:46,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:46,978::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103162 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:54:56,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:54:56,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102513 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:55:06,991::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:55:06,997::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100713 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:55:17,000::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:55:17,006::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104799 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:55:27,010::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:55:27,016::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102411 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:55:37,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:55:37,025::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100707 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:55:47,029::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:55:47,035::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100501 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:55:57,038::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:55:57,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988366 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:56:07,048::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:56:07,053::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104284 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:56:17,057::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:56:17,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103037 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:56:27,066::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:56:27,072::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108371 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:56:37,076::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:56:37,082::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101904 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:56:47,085::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:56:47,091::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106877 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:56:57,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:56:57,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000991357 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:57:07,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:57:07,110::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010588 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:57:17,114::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:57:17,119::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000969526 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:57:27,123::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:57:27,129::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010621 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:57:37,133::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:57:37,138::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103416 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:57:47,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:57:47,148::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104775 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:57:57,152::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:57:57,157::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998733 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:58:07,161::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:58:07,167::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108226 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:58:17,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:58:17,176::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101074 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:58:27,180::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:58:27,186::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010604 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:58:37,189::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:58:37,195::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100026 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:58:47,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:58:47,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010073 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:58:57,208::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:58:57,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000967587 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:07,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:07,223::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106314 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:17,226::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:17,232::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100945 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:27,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:27,241::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000984383 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:37,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:37,251::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010152 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:47,253::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 13:59:47,253::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:59:47,255::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:47,259::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000785639 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:47,260::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000785639 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 13:59:47,260::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 13:59:47,260::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 13:59:47,260::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 13:59:47,260::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:59:47,260::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:59:47,260::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:59:47,261::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:59:47,261::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 13:59:47,261::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:47,368::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:47,369::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 13:59:47,369::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 13:59:47,369::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 13:59:47,370::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 13:59:47,370::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 13:59:47,370::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:47,477::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:47,479::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:47,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000961869 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 13:59:57,489::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 13:59:57,495::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010208 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:00:07,498::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:00:07,504::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982185 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:00:17,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:00:17,513::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102183 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:00:27,517::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:00:27,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996006 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:00:37,526::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:00:37,532::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000928414 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:00:47,536::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:00:47,542::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112155 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:00:57,545::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:00:57,551::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107932 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:01:07,555::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:01:07,560::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100768 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:01:17,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:01:17,570::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106803 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:01:27,573::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:01:27,579::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103479 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:01:37,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:01:37,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101592 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:01:47,592::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:01:47,598::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102784 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:01:57,602::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:01:57,608::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00128171 s, 3.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:02:07,611::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:02:07,617::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110518 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:02:17,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:02:17,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105878 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:02:27,630::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:02:27,636::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102836 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:02:37,640::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:02:37,646::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103772 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:02:47,650::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:02:47,682::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0277937 s, 147 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:02:57,686::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:02:57,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108918 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:03:07,695::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:03:07,701::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010297 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:03:17,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:03:17,711::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107762 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:03:27,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:03:27,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099417 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:03:37,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:03:37,730::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109637 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:03:47,734::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:03:47,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100505 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:03:57,744::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:03:57,750::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106984 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:07,754::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:07,760::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100807 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:17,763::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:17,769::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000960587 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:27,773::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:27,779::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102471 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:37,782::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:37,788::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000969602 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:47,790::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:04:47,791::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:04:47,792::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:47,797::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000825053 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:47,797::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000825053 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:04:47,797::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:04:47,797::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:04:47,797::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:04:47,798::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:04:47,798::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:04:47,798::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:04:47,798::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:04:47,798::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:04:47,799::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:47,924::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:47,925::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:04:47,925::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:04:47,926::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:04:47,926::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:04:47,926::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:04:47,926::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:48,033::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:48,035::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:48,041::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000967136 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:04:58,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:04:58,051::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104297 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:05:08,054::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:05:08,060::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101585 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:05:18,064::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:05:18,070::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00093224 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:05:28,073::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:05:28,079::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101966 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:05:38,083::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:05:38,095::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100772 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:05:48,098::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:05:48,104::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107799 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:05:58,108::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:05:58,114::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112942 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:06:08,117::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:06:08,123::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010485 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:06:18,127::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:06:18,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110459 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:06:28,136::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:06:28,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010574 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:06:38,146::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:06:38,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107868 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:06:48,155::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:06:48,161::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010561 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:06:58,164::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:06:58,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101851 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:07:08,174::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:07:08,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100653 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:07:18,183::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:07:18,189::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107851 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:07:28,193::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:07:28,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103703 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:07:38,202::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:07:38,208::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010966 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:07:48,211::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:07:48,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011104 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:07:58,221::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:07:58,227::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104349 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:08:08,230::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:08:08,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105125 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:08:18,240::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:08:18,246::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105475 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:08:28,249::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:08:28,255::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103108 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:08:38,259::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:08:38,265::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102084 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:08:48,268::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:08:48,274::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103586 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:08:58,278::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:08:58,283::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988689 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:08,287::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:08,293::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103446 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:18,296::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:18,302::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100404 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:28,306::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:28,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109982 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:38,315::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:38,321::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107219 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:48,323::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:09:48,323::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:09:48,325::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:48,330::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000870544 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:48,330::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000870544 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:09:48,330::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:09:48,330::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:09:48,330::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:09:48,330::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:09:48,331::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:09:48,331::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:09:48,331::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:09:48,331::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:09:48,331::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:48,443::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:48,444::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:09:48,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:09:48,445::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:09:48,445::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:09:48,445::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:09:48,445::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:48,557::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:48,559::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:48,565::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000957493 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:09:58,568::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:09:58,574::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107415 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:10:08,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:10:08,584::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110719 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:10:18,588::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:10:18,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010868 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:10:28,597::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:10:28,603::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011095 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:10:38,607::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:10:38,613::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107143 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:10:48,616::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:10:48,622::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107699 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:10:58,626::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:10:58,632::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103461 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:11:08,635::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:11:08,641::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109287 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:11:18,645::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:11:18,650::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104947 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:11:28,654::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:11:28,660::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106618 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:11:38,663::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:11:38,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105704 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:11:48,673::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:11:48,678::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106816 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:11:58,682::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:11:58,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112335 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:12:08,692::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:12:08,701::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010202 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:12:18,705::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:12:18,711::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010359 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:12:28,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:12:28,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111605 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:12:38,724::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:12:38,730::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108949 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:12:48,733::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:12:48,739::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110021 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:12:58,742::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:12:58,748::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104927 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:13:08,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:13:08,758::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111146 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:13:18,761::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:13:18,767::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104954 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:13:28,771::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:13:28,777::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107966 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:13:38,781::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:13:38,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000987304 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:13:48,790::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:13:48,796::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110379 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:13:58,800::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:13:58,806::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107904 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:08,809::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:08,815::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108555 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:18,819::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:18,824::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102906 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:28,828::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:28,834::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111101 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:38,838::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:38,844::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998216 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:48,846::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:14:48,846::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:14:48,847::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:48,852::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000843254 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:48,853::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000843254 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:14:48,853::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:14:48,853::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:14:48,853::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:14:48,853::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:14:48,853::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:14:48,854::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:14:48,854::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:14:48,854::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:14:48,854::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:48,965::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:48,966::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:14:48,966::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:14:48,966::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:14:48,967::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:14:48,967::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:14:48,967::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:49,076::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:49,078::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:49,084::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000973604 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:14:59,088::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:14:59,094::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993055 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:15:09,097::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:15:09,103::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001028 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:15:19,106::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:15:19,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111077 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:15:29,116::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:15:29,122::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106024 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:15:39,126::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:15:39,131::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114071 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:15:49,135::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:15:49,141::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106316 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:15:59,145::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:15:59,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103326 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:16:09,154::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:16:09,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999709 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:16:19,163::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:16:19,169::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107374 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:16:29,173::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:16:29,179::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099654 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:16:39,182::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:16:39,188::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001009 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:16:49,192::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:16:49,197::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103682 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:16:59,201::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:16:59,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100075 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:17:09,211::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:17:09,216::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105572 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:17:19,220::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:17:19,226::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106576 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:17:29,230::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:17:29,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101355 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:17:39,239::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:17:39,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101657 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:17:49,248::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:17:49,254::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103723 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:17:59,258::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:17:59,264::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105243 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:18:09,267::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:18:09,273::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101727 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:18:19,277::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:18:19,283::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108829 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:18:29,286::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:18:29,292::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102548 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:18:39,296::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:18:39,302::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107118 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:18:49,305::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:18:49,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101637 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:18:59,315::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:18:59,321::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105694 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:09,324::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:09,335::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00092065 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:19,338::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:19,344::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104498 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:29,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:29,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104163 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:39,357::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:39,363::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105708 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:49,365::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:19:49,366::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:19:49,367::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:49,372::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000801475 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:49,372::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000801475 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:19:49,372::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:19:49,372::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:19:49,372::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:19:49,372::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:19:49,373::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:19:49,373::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:19:49,373::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:19:49,373::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:19:49,373::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:49,481::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:49,482::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:19:49,483::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:19:49,483::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:19:49,483::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:19:49,483::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:19:49,484::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:49,592::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:49,594::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:49,600::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00096195 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:19:59,604::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:19:59,610::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107384 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:20:09,613::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:20:09,619::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102955 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:20:19,623::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:20:19,629::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105196 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:20:29,632::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:20:29,638::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101023 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:20:39,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:20:39,648::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104192 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:20:49,651::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:20:49,657::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099476 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:20:59,661::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:20:59,666::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102672 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:21:09,670::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:21:09,676::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101941 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:21:19,679::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:21:19,685::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000995583 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:21:29,689::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:21:29,695::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100896 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:21:39,698::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:21:39,704::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103944 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:21:49,708::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:21:49,714::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104636 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:21:59,717::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:21:59,723::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102609 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:22:09,727::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:22:09,733::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110523 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:22:19,736::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:22:19,742::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000972903 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:22:29,745::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:22:29,751::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00116211 s, 3.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:22:39,755::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:22:39,761::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101461 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:22:49,764::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:22:49,770::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108231 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:22:59,774::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:22:59,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102585 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:23:09,783::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:23:09,789::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106085 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:23:19,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:23:19,798::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000957485 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:23:29,802::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:23:29,808::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106086 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:23:39,811::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:23:39,817::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100229 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:23:49,821::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:23:49,827::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104208 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:23:59,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:23:59,837::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102164 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:09,840::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:09,846::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100375 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:19,850::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:19,855::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102328 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:29,859::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:29,865::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107347 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:39,869::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:39,874::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000955835 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:49,876::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:24:49,877::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:24:49,879::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:49,883::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000872752 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:49,884::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000872752 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:24:49,884::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:24:49,884::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:24:49,884::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:24:49,884::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:24:49,884::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:24:49,885::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:24:49,885::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:24:49,885::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:24:49,885::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:49,992::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:49,993::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:24:49,993::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:24:49,994::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:24:49,994::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:24:49,994::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:24:49,994::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:50,101::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:24:50,103::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:24:50,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988989 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:25:00,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:25:00,118::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100586 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:25:10,122::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:25:10,128::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107961 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:25:20,131::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:25:20,137::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000976505 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:25:30,141::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:25:30,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109269 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:25:40,150::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:25:40,156::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100599 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:25:50,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:25:50,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110358 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:26:00,169::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:26:00,175::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000997169 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:26:10,178::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:26:10,184::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100535 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:26:20,188::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:26:20,194::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101047 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:26:30,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:26:30,203::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000992127 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:26:40,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:26:40,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100889 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:26:50,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:26:50,222::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000967475 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:27:00,226::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:27:00,232::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103064 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:27:10,235::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:27:10,241::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000944688 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:27:20,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:27:20,251::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010104 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:27:30,254::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:27:30,260::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000980685 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:27:40,264::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:27:40,269::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101053 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:27:50,273::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:27:50,279::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998201 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:28:00,283::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:28:00,289::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108826 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:28:10,292::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:28:10,298::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100462 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:28:20,302::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:28:20,307::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100763 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:28:30,311::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:28:30,317::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101638 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:28:40,320::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:28:40,326::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105164 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:28:50,330::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:28:50,336::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101311 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:00,339::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:00,345::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000995489 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:10,349::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:10,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103101 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:20,358::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:20,364::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100259 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:30,368::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:30,373::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000992911 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:40,377::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:40,383::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109162 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:50,385::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:29:50,385::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:29:50,387::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:50,392::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000818867 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:50,392::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000818867 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:29:50,392::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:29:50,392::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:29:50,392::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:29:50,392::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:29:50,393::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:29:50,393::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:29:50,393::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:29:50,393::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:29:50,394::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:50,500::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:50,501::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:29:50,502::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:29:50,502::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:29:50,502::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:29:50,502::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:29:50,503::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:50,610::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:29:50,612::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:29:50,618::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000983867 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:30:00,621::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:30:00,627::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106499 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:30:10,631::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:30:10,636::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101465 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:30:20,640::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:30:20,646::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105258 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:30:30,650::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:30:30,656::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101644 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:30:40,659::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:30:40,665::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106907 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:30:50,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:30:50,675::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101558 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:31:00,678::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:31:00,684::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000983669 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:31:10,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:31:10,693::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103726 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:31:20,697::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:31:20,703::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109945 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:31:30,707::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:31:30,712::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108932 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:31:40,716::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:31:40,722::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108689 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:31:50,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:31:50,732::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109281 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:32:00,735::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:32:00,741::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109142 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:32:10,745::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:32:10,751::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108625 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:32:20,755::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:32:20,760::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110396 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:32:30,764::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:32:30,770::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103888 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:32:40,774::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:32:40,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109826 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:32:50,784::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:32:50,789::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100238 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:33:00,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:33:00,799::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109055 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:33:10,803::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:33:10,809::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109881 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:33:20,812::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:33:20,818::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100582 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:33:30,822::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:33:30,828::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011234 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:33:40,832::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:33:40,837::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993665 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:33:50,841::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:33:50,847::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104181 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:00,851::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:00,856::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101485 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:10,860::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:10,866::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108783 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:20,870::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:20,876::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102021 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:30,879::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:30,885::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103528 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:40,889::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:40,895::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101998 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:50,897::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:34:50,897::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:34:50,899::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:50,904::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000943995 s, 2.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:50,904::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000943995 s, 2.2 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:34:50,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:34:50,904::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:34:50,904::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:34:50,904::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:34:50,905::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:34:50,905::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:34:50,905::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:34:50,905::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:34:50,905::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:51,013::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:51,014::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:34:51,014::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:34:51,015::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:34:51,015::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:34:51,015::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:34:51,016::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:51,123::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:34:51,125::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:34:51,131::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988154 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:35:01,134::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:35:01,140::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101749 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:35:11,144::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:35:11,150::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112933 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:35:21,153::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:35:21,159::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108696 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:35:31,163::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:35:31,169::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114221 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:35:41,172::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:35:41,178::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110584 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:35:51,182::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:35:51,188::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108875 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:36:01,191::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:36:01,197::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111252 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:36:11,201::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:36:11,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112167 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:36:21,211::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:36:21,216::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111812 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:36:31,220::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:36:31,226::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0013303 s, 3.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:36:41,230::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:36:41,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00113062 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:36:51,239::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:36:51,245::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103973 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:37:01,249::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:37:01,255::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107321 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:37:11,258::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:37:11,264::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108866 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:37:21,268::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:37:21,274::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103302 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:37:31,277::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:37:31,283::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105692 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:37:41,287::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:37:41,293::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101425 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:37:51,297::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:37:51,302::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105592 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:38:01,306::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:38:01,312::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100542 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:38:11,316::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:38:11,322::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104989 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:38:21,325::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:38:21,331::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000991218 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:38:31,334::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:38:31,340::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010622 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:38:41,344::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:38:41,350::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100882 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:38:51,354::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:38:51,360::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101417 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:01,363::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:01,369::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010175 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:11,373::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:11,378::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103895 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:21,382::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:21,388::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101679 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:31,391::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:31,397::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00099055 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:41,401::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:41,407::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101598 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:51,409::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:39:51,409::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:39:51,411::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:51,416::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000809556 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:51,416::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000809556 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:39:51,416::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:39:51,416::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:39:51,416::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:39:51,416::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:39:51,416::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:39:51,417::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:39:51,417::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:39:51,417::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:39:51,417::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:51,524::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:51,525::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:39:51,525::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:39:51,525::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:39:51,525::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:39:51,526::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:39:51,526::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:51,632::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:39:51,634::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:39:51,640::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000985788 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:40:01,643::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:40:01,649::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101717 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:40:11,653::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:40:11,659::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100561 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:40:21,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:40:21,668::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999651 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:40:31,672::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:40:31,678::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108701 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:40:41,682::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:40:41,687::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109304 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:40:51,691::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:40:51,697::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106382 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:41:01,700::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:41:01,706::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107361 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:41:11,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:41:11,716::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103176 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:41:21,719::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:41:21,725::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106114 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:41:31,729::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:41:31,735::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102676 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:41:41,739::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:41:41,744::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102767 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:41:51,748::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:41:51,754::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105293 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:42:01,757::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:42:01,763::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010549 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:42:11,767::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:42:11,773::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000986565 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:42:21,776::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:42:21,782::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105993 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:42:31,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:42:31,791::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994548 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:42:41,795::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:42:41,801::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100736 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:42:51,805::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:42:51,811::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101907 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:43:01,814::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:43:01,820::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000986486 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:43:11,824::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:43:11,830::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102159 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:43:21,833::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:43:21,839::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107999 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:43:31,843::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:43:31,849::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102391 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:43:41,853::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:43:41,859::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109677 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:43:51,862::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:43:51,868::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102332 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:01,872::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:01,878::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109429 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:11,882::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:11,888::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989497 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:21,891::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:21,897::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108002 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:31,901::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:31,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001031 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:41,910::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:41,916::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010539 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:51,918::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:44:51,919::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:44:51,920::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:51,925::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000815249 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:51,925::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000815249 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:44:51,925::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:44:51,925::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:44:51,925::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:44:51,926::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:44:51,926::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:44:51,926::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:44:51,926::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:44:51,926::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:44:51,927::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:52,034::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:52,035::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:44:52,035::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:44:52,036::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:44:52,036::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:44:52,036::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:44:52,037::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:52,143::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:44:52,145::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:44:52,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000954935 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:45:02,159::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:45:02,165::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106213 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:45:12,169::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:45:12,175::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104193 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:45:22,178::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:45:22,184::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107155 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:45:32,188::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:45:32,194::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103165 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:45:42,198::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:45:42,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101259 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:45:52,207::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:45:52,213::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103124 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:46:02,217::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:46:02,223::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102183 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:46:12,227::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:46:12,232::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102451 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:46:22,236::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:46:22,310::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0685772 s, 59.7 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:46:32,313::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:46:32,319::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011035 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:46:42,323::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:46:42,329::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999221 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:46:52,332::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:46:52,338::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106388 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:47:02,342::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:47:02,348::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101867 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:47:12,351::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:47:12,357::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106267 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:47:22,361::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:47:22,366::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101906 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:47:32,370::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:47:32,376::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109516 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:47:42,380::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:47:42,386::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101591 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:47:52,389::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:47:52,395::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107137 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:48:02,399::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:48:02,405::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100997 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:48:12,408::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:48:12,414::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104028 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:48:22,418::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:48:22,423::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102116 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:48:32,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:48:32,433::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010491 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:48:42,437::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:48:42,443::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101324 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:48:52,448::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:48:52,456::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010225 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:02,464::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:02,470::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103173 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:12,474::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:12,480::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103462 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:22,483::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:22,489::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101486 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:32,493::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:32,499::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109057 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:42,503::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:42,508::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000987917 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:52,510::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:49:52,511::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:49:52,512::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:52,517::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000893834 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:52,517::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000893834 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:49:52,517::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:49:52,517::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:49:52,518::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:49:52,518::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:49:52,524::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:49:52,524::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:49:52,524::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:49:52,524::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:49:52,524::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:52,671::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:52,672::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:49:52,672::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:49:52,673::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:49:52,673::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:49:52,673::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:49:52,673::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:52,781::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:49:52,783::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:49:52,789::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103467 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:50:02,794::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:50:02,800::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103006 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:50:12,804::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:50:12,810::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107516 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:50:22,813::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:50:22,819::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101476 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:50:32,823::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:50:32,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112646 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:50:42,833::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:50:42,838::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103058 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:50:52,842::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:50:52,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106807 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:51:02,852::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:51:02,857::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010161 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:51:12,861::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:51:12,867::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106176 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:51:22,871::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:51:22,876::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102018 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:51:32,880::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:51:32,886::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0009977 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:51:42,890::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:51:42,896::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101852 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:51:52,899::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:51:52,905::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100443 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:52:02,909::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:52:02,915::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101818 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:52:12,918::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:52:12,924::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000967055 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:52:22,928::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:52:22,934::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100593 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:52:32,937::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:52:32,943::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100016 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:52:42,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:52:42,953::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110637 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:52:52,956::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:52:52,962::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000998727 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:53:02,966::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:53:02,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103712 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:53:12,976::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:53:12,981::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101243 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:53:22,985::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:53:22,991::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001037 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:53:32,995::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:53:33,000::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979432 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:53:43,004::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:53:43,010::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103391 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:53:53,014::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:53:53,019::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999477 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:03,023::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:03,029::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106009 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:13,033::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:13,038::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102431 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:23,042::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:23,048::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103364 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:33,052::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:33,058::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102335 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:43,062::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:43,067::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102486 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:53,070::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:54:53,071::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:54:53,079::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:53,086::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000862513 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:53,087::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000862513 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:54:53,087::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:54:53,087::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:54:53,087::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:54:53,087::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:54:53,091::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:54:53,091::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:54:53,091::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:54:53,092::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:54:53,092::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:53,240::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:53,241::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:54:53,241::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:54:53,242::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:54:53,242::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:54:53,242::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:54:53,243::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:53,354::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:54:53,357::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:54:53,363::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000971753 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:55:03,369::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:55:03,375::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111258 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:55:13,379::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:55:13,384::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102741 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:55:23,388::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:55:23,394::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108546 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:55:33,398::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:55:33,404::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103061 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:55:43,407::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:55:43,413::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102593 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:55:53,417::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:55:53,423::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102054 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:56:03,427::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:56:03,432::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100829 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:56:13,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:56:13,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101866 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:56:23,446::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:56:23,452::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112399 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:56:33,455::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:56:33,461::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107735 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:56:43,465::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:56:43,471::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112577 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:56:53,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:56:53,481::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111537 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:57:03,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:57:03,491::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110559 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:57:13,494::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:57:13,500::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102184 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:57:23,504::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:57:23,510::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112299 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:57:33,514::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:57:33,520::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110405 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:57:43,523::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:57:43,529::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112062 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:57:53,533::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:57:53,539::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114247 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:58:03,543::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:58:03,549::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114131 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:58:13,552::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:58:13,558::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00131335 s, 3.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:58:23,562::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:58:23,568::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000969572 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:58:33,572::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:58:33,578::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101343 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:58:43,582::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:58:43,588::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101874 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:58:53,591::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:58:53,597::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105456 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:03,601::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:03,652::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0461236 s, 88.8 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:13,656::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:13,662::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107156 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:23,666::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:23,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102909 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:33,675::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:33,681::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105155 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:43,685::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:43,691::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108476 s, 3.8 MB/s\n'; <rc> = 0 >Thread-44::DEBUG::2014-06-04 14:59:51,697::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-44::DEBUG::2014-06-04 14:59:51,701::task::595::TaskManager.Task::(_updateState) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::moving from state init -> state preparing >Thread-44::INFO::2014-06-04 14:59:51,702::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', spUUID='831ef374-8947-47f2-938f-5ec938f4fcef', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-44::DEBUG::2014-06-04 14:59:51,702::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`b3b27b3e-356f-4368-a2c8-aaa05816a5c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-44::DEBUG::2014-06-04 14:59:51,702::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'shared' >Thread-44::DEBUG::2014-06-04 14:59:51,702::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'shared' (1 active user) >Thread-44::DEBUG::2014-06-04 14:59:51,702::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`b3b27b3e-356f-4368-a2c8-aaa05816a5c3`::Granted request >Thread-44::DEBUG::2014-06-04 14:59:51,702::task::827::TaskManager.Task::(resourceAcquired) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (shared) >Thread-44::DEBUG::2014-06-04 14:59:51,702::task::990::TaskManager.Task::(_decref) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::ref 1 aborting False >Thread-44::DEBUG::2014-06-04 14:59:51,703::resourceManager::198::ResourceManager.Request::(__init__) ResName=`32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`6da533a4-9a92-44ca-8c49-4dc2e7dd47d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-44::DEBUG::2014-06-04 14:59:51,703::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-44::ERROR::2014-06-04 14:59:51,703::task::866::TaskManager.Task::(_setError) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3171, in prepareVolume > imgUUID, lockType, timeout) > File "/usr/share/vdsm/storage/resourceManager.py", line 511, in acquireResource > request = self.registerResource(namespace, name, lockType, callback) > File "/usr/share/vdsm/storage/resourceManager.py", line 549, in registerResource > "manager" % namespace) >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::885::TaskManager.Task::(_run) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::Task._run: dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7 ('32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '831ef374-8947-47f2-938f-5ec938f4fcef', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', True) {} failed - stopping task >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::1211::TaskManager.Task::(stop) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::stopping in state preparing (force False) >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::990::TaskManager.Task::(_decref) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::ref 1 aborting True >Thread-44::INFO::2014-06-04 14:59:51,704::task::1168::TaskManager.Task::(prepare) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::aborting: Task is aborted: u"Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager" - code 100 >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::1173::TaskManager.Task::(prepare) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::Prepare: aborted: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::990::TaskManager.Task::(_decref) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::ref 0 aborting True >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::925::TaskManager.Task::(_doAbort) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::Task._doAbort: force False >Thread-44::DEBUG::2014-06-04 14:59:51,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::595::TaskManager.Task::(_updateState) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::moving from state preparing -> state aborting >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::550::TaskManager.Task::(__state_aborting) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::_aborting: recover policy none >Thread-44::DEBUG::2014-06-04 14:59:51,704::task::595::TaskManager.Task::(_updateState) Task=`dca9ecd0-1ebc-4849-9f77-c6c6255d6cb7`::moving from state aborting -> state failed >Thread-44::DEBUG::2014-06-04 14:59:51,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-44::DEBUG::2014-06-04 14:59:51,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-06-04 14:59:51,705::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-44::DEBUG::2014-06-04 14:59:51,705::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-44::DEBUG::2014-06-04 14:59:51,705::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-44::DEBUG::2014-06-04 14:59:51,705::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-44::ERROR::2014-06-04 14:59:51,705::dispatcher::68::Storage.Dispatcher.Protect::(run) Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 60, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1176, in prepare > raise self.error >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-28::DEBUG::2014-06-04 14:59:53,693::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 14:59:53,693::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:59:53,695::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:53,699::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000846562 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:53,700::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000846562 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 14:59:53,700::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 14:59:53,700::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 14:59:53,700::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 14:59:53,700::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:59:53,700::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:59:53,701::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:59:53,701::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:59:53,701::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 14:59:53,701::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:53,823::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:53,824::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 14:59:53,824::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 14:59:53,825::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 14:59:53,825::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 14:59:53,825::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 14:59:53,825::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:53,935::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 14:59:53,937::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 14:59:53,943::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000930669 s, 4.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:00:03,947::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:00:03,953::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000982031 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:00:13,957::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:00:13,963::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103781 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:00:23,966::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:00:23,972::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103627 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:00:33,976::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:00:33,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110034 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:00:43,985::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:00:43,991::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988838 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:00:53,995::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:00:54,001::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105102 s, 3.9 MB/s\n'; <rc> = 0 >Thread-45::DEBUG::2014-06-04 15:01:00,965::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-45::DEBUG::2014-06-04 15:01:00,966::task::595::TaskManager.Task::(_updateState) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::moving from state init -> state preparing >Thread-45::INFO::2014-06-04 15:01:00,966::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', spUUID='831ef374-8947-47f2-938f-5ec938f4fcef', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-45::DEBUG::2014-06-04 15:01:00,966::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`21778ffe-d7f4-4f63-acd8-20af073626ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-45::DEBUG::2014-06-04 15:01:00,966::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'shared' >Thread-45::DEBUG::2014-06-04 15:01:00,967::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'shared' (1 active user) >Thread-45::DEBUG::2014-06-04 15:01:00,967::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`21778ffe-d7f4-4f63-acd8-20af073626ce`::Granted request >Thread-45::DEBUG::2014-06-04 15:01:00,967::task::827::TaskManager.Task::(resourceAcquired) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (shared) >Thread-45::DEBUG::2014-06-04 15:01:00,967::task::990::TaskManager.Task::(_decref) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::ref 1 aborting False >Thread-45::DEBUG::2014-06-04 15:01:00,967::resourceManager::198::ResourceManager.Request::(__init__) ResName=`32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`d153a3c8-8ad0-4f70-918b-8e84acd5f691`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-45::DEBUG::2014-06-04 15:01:00,967::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-45::ERROR::2014-06-04 15:01:00,967::task::866::TaskManager.Task::(_setError) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3171, in prepareVolume > imgUUID, lockType, timeout) > File "/usr/share/vdsm/storage/resourceManager.py", line 511, in acquireResource > request = self.registerResource(namespace, name, lockType, callback) > File "/usr/share/vdsm/storage/resourceManager.py", line 549, in registerResource > "manager" % namespace) >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::885::TaskManager.Task::(_run) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::Task._run: 3c1b6b30-deb5-47d1-8f51-39376247de85 ('32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '831ef374-8947-47f2-938f-5ec938f4fcef', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', True) {} failed - stopping task >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::1211::TaskManager.Task::(stop) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::stopping in state preparing (force False) >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::990::TaskManager.Task::(_decref) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::ref 1 aborting True >Thread-45::INFO::2014-06-04 15:01:00,968::task::1168::TaskManager.Task::(prepare) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::aborting: Task is aborted: u"Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager" - code 100 >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::1173::TaskManager.Task::(prepare) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::Prepare: aborted: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::990::TaskManager.Task::(_decref) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::ref 0 aborting True >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::925::TaskManager.Task::(_doAbort) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::Task._doAbort: force False >Thread-45::DEBUG::2014-06-04 15:01:00,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-45::DEBUG::2014-06-04 15:01:00,968::task::595::TaskManager.Task::(_updateState) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::moving from state preparing -> state aborting >Thread-45::DEBUG::2014-06-04 15:01:00,969::task::550::TaskManager.Task::(__state_aborting) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::_aborting: recover policy none >Thread-45::DEBUG::2014-06-04 15:01:00,969::task::595::TaskManager.Task::(_updateState) Task=`3c1b6b30-deb5-47d1-8f51-39376247de85`::moving from state aborting -> state failed >Thread-45::DEBUG::2014-06-04 15:01:00,969::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-45::DEBUG::2014-06-04 15:01:00,969::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-45::DEBUG::2014-06-04 15:01:00,969::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-45::DEBUG::2014-06-04 15:01:00,969::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-45::DEBUG::2014-06-04 15:01:00,969::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-45::DEBUG::2014-06-04 15:01:00,969::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-45::ERROR::2014-06-04 15:01:00,969::dispatcher::68::Storage.Dispatcher.Protect::(run) Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 60, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1176, in prepare > raise self.error >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-28::DEBUG::2014-06-04 15:01:04,005::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:01:04,011::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010433 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:01:14,015::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:01:14,021::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010924 s, 3.7 MB/s\n'; <rc> = 0 >Thread-46::DEBUG::2014-06-04 15:01:17,428::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-46::DEBUG::2014-06-04 15:01:17,429::task::595::TaskManager.Task::(_updateState) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::moving from state init -> state preparing >Thread-46::INFO::2014-06-04 15:01:17,429::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', spUUID='831ef374-8947-47f2-938f-5ec938f4fcef', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-46::DEBUG::2014-06-04 15:01:17,429::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`6e192faf-af8f-4b24-8b98-9e3fc704a2b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-46::DEBUG::2014-06-04 15:01:17,429::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'shared' >Thread-46::DEBUG::2014-06-04 15:01:17,429::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'shared' (1 active user) >Thread-46::DEBUG::2014-06-04 15:01:17,429::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`6e192faf-af8f-4b24-8b98-9e3fc704a2b0`::Granted request >Thread-46::DEBUG::2014-06-04 15:01:17,430::task::827::TaskManager.Task::(resourceAcquired) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (shared) >Thread-46::DEBUG::2014-06-04 15:01:17,430::task::990::TaskManager.Task::(_decref) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::ref 1 aborting False >Thread-46::DEBUG::2014-06-04 15:01:17,430::resourceManager::198::ResourceManager.Request::(__init__) ResName=`32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`a22039d3-74ae-419c-8e23-eccaa3be62ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-46::DEBUG::2014-06-04 15:01:17,430::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-46::ERROR::2014-06-04 15:01:17,430::task::866::TaskManager.Task::(_setError) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3171, in prepareVolume > imgUUID, lockType, timeout) > File "/usr/share/vdsm/storage/resourceManager.py", line 511, in acquireResource > request = self.registerResource(namespace, name, lockType, callback) > File "/usr/share/vdsm/storage/resourceManager.py", line 549, in registerResource > "manager" % namespace) >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-46::DEBUG::2014-06-04 15:01:17,430::task::885::TaskManager.Task::(_run) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::Task._run: 09dff50d-789b-4c31-bdd3-74aadada5bb2 ('32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '831ef374-8947-47f2-938f-5ec938f4fcef', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', True) {} failed - stopping task >Thread-46::DEBUG::2014-06-04 15:01:17,430::task::1211::TaskManager.Task::(stop) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::stopping in state preparing (force False) >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::990::TaskManager.Task::(_decref) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::ref 1 aborting True >Thread-46::INFO::2014-06-04 15:01:17,431::task::1168::TaskManager.Task::(prepare) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::aborting: Task is aborted: u"Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager" - code 100 >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::1173::TaskManager.Task::(prepare) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::Prepare: aborted: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::990::TaskManager.Task::(_decref) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::ref 0 aborting True >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::925::TaskManager.Task::(_doAbort) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::Task._doAbort: force False >Thread-46::DEBUG::2014-06-04 15:01:17,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::595::TaskManager.Task::(_updateState) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::moving from state preparing -> state aborting >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::550::TaskManager.Task::(__state_aborting) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::_aborting: recover policy none >Thread-46::DEBUG::2014-06-04 15:01:17,431::task::595::TaskManager.Task::(_updateState) Task=`09dff50d-789b-4c31-bdd3-74aadada5bb2`::moving from state aborting -> state failed >Thread-46::DEBUG::2014-06-04 15:01:17,431::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-46::DEBUG::2014-06-04 15:01:17,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-06-04 15:01:17,432::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-46::DEBUG::2014-06-04 15:01:17,432::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-46::DEBUG::2014-06-04 15:01:17,432::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-46::DEBUG::2014-06-04 15:01:17,432::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-46::ERROR::2014-06-04 15:01:17,432::dispatcher::68::Storage.Dispatcher.Protect::(run) Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 60, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1176, in prepare > raise self.error >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-28::DEBUG::2014-06-04 15:01:24,025::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:01:24,030::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108051 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:01:34,034::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:01:34,040::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109479 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:01:44,044::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:01:44,050::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102515 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:01:54,053::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:01:54,059::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106745 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:02:04,063::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:02:04,069::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109769 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:02:14,073::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:02:14,079::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112161 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:02:24,083::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:02:24,089::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108383 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:02:34,093::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:02:34,099::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111471 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:02:44,102::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:02:44,108::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101345 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:02:54,112::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:02:54,118::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109541 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:03:04,122::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:03:04,127::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105051 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:03:14,131::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:03:14,137::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108411 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:03:24,141::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:03:24,147::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105128 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:03:34,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:03:34,156::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108178 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:03:44,160::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:03:44,166::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010764 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:03:54,170::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:03:54,176::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110428 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:04,180::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:04,185::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102933 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:14,189::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:14,195::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107759 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:24,199::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:24,205::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108158 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:34,209::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:34,215::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010904 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:44,219::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:44,225::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102575 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:54,227::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 15:04:54,227::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:04:54,229::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:54,234::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000909466 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:54,234::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000909466 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 15:04:54,234::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 15:04:54,234::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 15:04:54,234::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:04:54,235::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:04:54,235::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:04:54,235::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:04:54,235::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:04:54,235::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:04:54,236::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:54,356::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:54,358::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:04:54,358::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 15:04:54,358::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 15:04:54,358::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 15:04:54,359::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 15:04:54,359::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:54,467::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:04:54,469::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:04:54,475::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000965652 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:05:04,479::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:05:04,485::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000961687 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:05:14,489::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:05:14,521::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0268277 s, 153 kB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:05:24,525::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:05:24,531::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103577 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:05:34,535::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:05:34,540::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111054 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:05:44,544::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:05:44,550::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108872 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:05:54,554::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:05:54,560::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109981 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:06:04,564::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:06:04,570::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010988 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:06:14,574::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:06:14,580::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109819 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:06:24,583::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:06:24,589::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110972 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:06:34,593::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:06:34,599::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109991 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:06:44,603::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:06:44,609::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111696 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:06:54,613::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:06:54,618::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001093 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:07:04,622::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:07:04,628::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105529 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:07:14,632::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:07:14,638::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109503 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:07:24,642::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:07:24,648::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00115173 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:07:34,651::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:07:34,657::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107632 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:07:44,661::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:07:44,667::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103725 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:07:54,671::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:07:54,677::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106749 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:08:04,680::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:08:04,686::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102653 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:08:14,690::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:08:14,696::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101467 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:08:24,701::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:08:24,708::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00154817 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:08:34,717::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:08:34,722::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109714 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:08:44,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:08:44,732::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107078 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:08:54,736::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:08:54,742::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102341 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:04,746::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:04,752::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110543 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:14,756::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:14,762::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105363 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:24,766::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:24,772::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001061 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:34,776::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:34,782::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988525 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:44,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:44,792::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105902 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:54,794::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 15:09:54,794::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:09:54,796::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:54,800::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00078366 s, 2.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:54,801::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00078366 s, 2.6 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 15:09:54,801::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 15:09:54,801::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 15:09:54,801::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:09:54,801::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:09:54,806::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:09:54,809::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:09:54,810::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:09:54,810::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:09:54,810::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:54,960::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:54,960::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:09:54,961::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 15:09:54,961::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 15:09:54,962::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 15:09:54,962::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 15:09:54,962::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:55,075::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:09:55,077::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:09:55,083::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000944717 s, 4.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:10:05,087::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:10:05,093::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107085 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:10:15,097::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:10:15,103::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101919 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:10:25,107::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:10:25,113::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107114 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:10:35,117::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:10:35,122::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000986997 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:10:45,126::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:10:45,132::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104672 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:10:55,136::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:10:55,142::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102812 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:11:05,146::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:11:05,151::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010211 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:11:15,155::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:11:15,161::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103028 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:11:25,165::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:11:25,171::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103805 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:11:35,174::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:11:35,180::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110388 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:11:45,184::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:11:45,190::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103188 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:11:55,194::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:11:55,199::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011147 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:12:05,204::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:12:05,211::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101937 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:12:15,221::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:12:15,228::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103104 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:12:25,250::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:12:25,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990065 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:12:35,260::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:12:35,266::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106617 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:12:45,269::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:12:45,275::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000987563 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:12:55,279::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:12:55,285::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110313 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:13:05,289::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:13:05,295::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102326 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:13:15,298::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:13:15,304::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111133 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:13:25,308::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:13:25,314::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100917 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:13:35,317::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:13:35,323::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106738 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:13:45,327::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:13:45,333::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102951 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:13:55,336::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:13:55,342::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103753 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:05,346::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:05,352::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103317 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:15,355::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:15,361::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103345 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:25,365::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:25,371::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103029 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:35,374::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:35,380::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108426 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:45,384::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:45,390::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102829 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:55,392::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 15:14:55,392::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:14:55,394::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:55,399::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00088499 s, 2.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:55,399::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00088499 s, 2.3 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 15:14:55,399::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 15:14:55,399::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 15:14:55,399::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:14:55,399::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:14:55,405::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:14:55,405::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:14:55,405::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:14:55,406::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:14:55,406::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:55,553::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:55,555::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:14:55,555::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 15:14:55,556::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 15:14:55,556::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 15:14:55,556::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 15:14:55,557::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:55,667::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:14:55,669::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:14:55,675::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000993955 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:15:05,679::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:15:05,685::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109952 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:15:15,688::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:15:15,697::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010951 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:15:25,700::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:15:25,706::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110454 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:15:35,710::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:15:35,716::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108718 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:15:45,720::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:15:45,726::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100836 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:15:55,729::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:15:55,735::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108353 s, 3.8 MB/s\n'; <rc> = 0 >Thread-47::DEBUG::2014-06-04 15:16:00,244::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-47::DEBUG::2014-06-04 15:16:00,245::task::595::TaskManager.Task::(_updateState) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::moving from state init -> state preparing >Thread-47::INFO::2014-06-04 15:16:00,245::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', spUUID='831ef374-8947-47f2-938f-5ec938f4fcef', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-47::DEBUG::2014-06-04 15:16:00,245::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`afe8aa67-3ac8-425d-b892-f55d1450e73c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-47::DEBUG::2014-06-04 15:16:00,245::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' for lock type 'shared' >Thread-47::DEBUG::2014-06-04 15:16:00,246::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free. Now locking as 'shared' (1 active user) >Thread-47::DEBUG::2014-06-04 15:16:00,246::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512`ReqID=`afe8aa67-3ac8-425d-b892-f55d1450e73c`::Granted request >Thread-47::DEBUG::2014-06-04 15:16:00,246::task::827::TaskManager.Task::(resourceAcquired) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::_resourcesAcquired: Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512 (shared) >Thread-47::DEBUG::2014-06-04 15:16:00,246::task::990::TaskManager.Task::(_decref) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::ref 1 aborting False >Thread-47::DEBUG::2014-06-04 15:16:00,246::resourceManager::198::ResourceManager.Request::(__init__) ResName=`32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`b753def1-ea97-43dd-8bf0-37c05e135bbb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-47::DEBUG::2014-06-04 15:16:00,246::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-47::ERROR::2014-06-04 15:16:00,246::task::866::TaskManager.Task::(_setError) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3171, in prepareVolume > imgUUID, lockType, timeout) > File "/usr/share/vdsm/storage/resourceManager.py", line 511, in acquireResource > request = self.registerResource(namespace, name, lockType, callback) > File "/usr/share/vdsm/storage/resourceManager.py", line 549, in registerResource > "manager" % namespace) >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-47::DEBUG::2014-06-04 15:16:00,247::task::885::TaskManager.Task::(_run) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::Task._run: 516c383e-e490-41dc-9d2b-9e31926348f8 ('32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '831ef374-8947-47f2-938f-5ec938f4fcef', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', True) {} failed - stopping task >Thread-47::DEBUG::2014-06-04 15:16:00,247::task::1211::TaskManager.Task::(stop) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::stopping in state preparing (force False) >Thread-47::DEBUG::2014-06-04 15:16:00,247::task::990::TaskManager.Task::(_decref) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::ref 1 aborting True >Thread-47::INFO::2014-06-04 15:16:00,247::task::1168::TaskManager.Task::(prepare) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::aborting: Task is aborted: u"Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager" - code 100 >Thread-47::DEBUG::2014-06-04 15:16:00,248::task::1173::TaskManager.Task::(prepare) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::Prepare: aborted: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-47::DEBUG::2014-06-04 15:16:00,248::task::990::TaskManager.Task::(_decref) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::ref 0 aborting True >Thread-47::DEBUG::2014-06-04 15:16:00,248::task::925::TaskManager.Task::(_doAbort) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::Task._doAbort: force False >Thread-47::DEBUG::2014-06-04 15:16:00,248::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-47::DEBUG::2014-06-04 15:16:00,248::task::595::TaskManager.Task::(_updateState) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::moving from state preparing -> state aborting >Thread-47::DEBUG::2014-06-04 15:16:00,248::task::550::TaskManager.Task::(__state_aborting) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::_aborting: recover policy none >Thread-47::DEBUG::2014-06-04 15:16:00,248::task::595::TaskManager.Task::(_updateState) Task=`516c383e-e490-41dc-9d2b-9e31926348f8`::moving from state aborting -> state failed >Thread-47::DEBUG::2014-06-04 15:16:00,248::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512': < ResourceRef 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', isValid: 'True' obj: 'None'>} >Thread-47::DEBUG::2014-06-04 15:16:00,248::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-47::DEBUG::2014-06-04 15:16:00,248::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' >Thread-47::DEBUG::2014-06-04 15:16:00,248::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' (0 active users) >Thread-47::DEBUG::2014-06-04 15:16:00,249::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512' is free, finding out if anyone is waiting for it. >Thread-47::DEBUG::2014-06-04 15:16:00,249::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.32dab0ff-9eaa-41c7-ae50-4e6ef6355512', Clearing records. >Thread-47::ERROR::2014-06-04 15:16:00,249::dispatcher::68::Storage.Dispatcher.Protect::(run) Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Traceback (most recent call last): > File "/usr/share/vdsm/storage/dispatcher.py", line 60, in run > result = ctask.prepare(self.func, *args, **kwargs) > File "/usr/share/vdsm/storage/task.py", line 103, in wrapper > return m(self, *a, **kw) > File "/usr/share/vdsm/storage/task.py", line 1176, in prepare > raise self.error >ValueError: Namespace '32dab0ff-9eaa-41c7-ae50-4e6ef6355512_imageNS' is not registered with this manager >Thread-28::DEBUG::2014-06-04 15:16:05,739::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:16:05,767::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103424 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:16:15,771::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:16:15,777::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110596 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:16:25,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:16:25,786::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.001028 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:16:35,790::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:16:35,796::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111818 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:16:45,802::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:16:45,811::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010356 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:16:55,819::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:16:55,825::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102732 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:17:05,829::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:17:05,835::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010187 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:17:15,838::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:17:15,844::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994729 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:17:25,848::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:17:25,854::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100576 s, 4.1 MB/s\n'; <rc> = 0 >Thread-48::DEBUG::2014-06-04 15:17:27,569::BindingXMLRPC::251::vds::(wrapper) client [10.34.63.104] >Thread-48::DEBUG::2014-06-04 15:17:27,575::task::595::TaskManager.Task::(_updateState) Task=`ff072163-06ce-4149-b375-17e8e3375189`::moving from state init -> state preparing >Thread-48::INFO::2014-06-04 15:17:27,576::logUtils::44::dispatcher::(wrapper) Run and protect: prepareVolume(sdUUID='831ef374-8947-47f2-938f-5ec938f4fcef', spUUID='32dab0ff-9eaa-41c7-ae50-4e6ef6355512', imgUUID='8f3f3871-6aab-4f26-811f-c8e1803414fd', volUUID='81fbcbaf-2264-4fa8-831f-da5bf9b5281b', rw=True, options=None) >Thread-48::DEBUG::2014-06-04 15:17:27,576::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`af93a27b-43f2-43a9-9db5-8bcc7bd3ea8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3165' at 'prepareVolume' >Thread-48::DEBUG::2014-06-04 15:17:27,576::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' for lock type 'shared' >Thread-48::DEBUG::2014-06-04 15:17:27,576::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free. Now locking as 'shared' (1 active user) >Thread-48::DEBUG::2014-06-04 15:17:27,576::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.831ef374-8947-47f2-938f-5ec938f4fcef`ReqID=`af93a27b-43f2-43a9-9db5-8bcc7bd3ea8a`::Granted request >Thread-48::DEBUG::2014-06-04 15:17:27,576::task::827::TaskManager.Task::(resourceAcquired) Task=`ff072163-06ce-4149-b375-17e8e3375189`::_resourcesAcquired: Storage.831ef374-8947-47f2-938f-5ec938f4fcef (shared) >Thread-48::DEBUG::2014-06-04 15:17:27,577::task::990::TaskManager.Task::(_decref) Task=`ff072163-06ce-4149-b375-17e8e3375189`::ref 1 aborting False >Thread-48::DEBUG::2014-06-04 15:17:27,577::resourceManager::198::ResourceManager.Request::(__init__) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`10f6af6b-164c-4dbb-ba35-c6e28ea2c7e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3171' at 'prepareVolume' >Thread-48::DEBUG::2014-06-04 15:17:27,577::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd' for lock type 'exclusive' >Thread-48::DEBUG::2014-06-04 15:17:27,577::lvm::426::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-48::DEBUG::2014-06-04 15:17:27,577::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-48::DEBUG::2014-06-04 15:17:27,720::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-48::DEBUG::2014-06-04 15:17:27,725::lvm::461::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-48::DEBUG::2014-06-04 15:17:27,725::lvm::461::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-48::ERROR::2014-06-04 15:17:27,726::blockVolume::421::Storage.Volume::(validateImagePath) Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/blockVolume.py", line 419, in validateImagePath > os.mkdir(imageDir, 0o755) >OSError: [Errno 2] No such file or directory: '/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd' >Thread-48::WARNING::2014-06-04 15:17:27,726::resourceManager::591::ResourceManager::(registerResource) Resource factory failed to create resource '831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd'. Canceling request. >Traceback (most recent call last): > File "/usr/share/vdsm/storage/resourceManager.py", line 587, in registerResource > obj = namespaceObj.factory.createResource(name, lockType) > File "/usr/share/vdsm/storage/resourceFactories.py", line 193, in createResource > lockType) > File "/usr/share/vdsm/storage/resourceFactories.py", line 122, in __getResourceCandidatesList > imgUUID=resourceName) > File "/usr/share/vdsm/storage/image.py", line 187, in getChain > srcVol = volclass(self.repoPath, sdUUID, imgUUID, uuidlist[0]) > File "/usr/share/vdsm/storage/blockVolume.py", line 80, in __init__ > volume.Volume.__init__(self, repoPath, sdUUID, imgUUID, volUUID) > File "/usr/share/vdsm/storage/volume.py", line 140, in __init__ > self.validate() > File "/usr/share/vdsm/storage/blockVolume.py", line 89, in validate > volume.Volume.validate(self) > File "/usr/share/vdsm/storage/volume.py", line 152, in validate > self.validateImagePath() > File "/usr/share/vdsm/storage/blockVolume.py", line 422, in validateImagePath > raise se.ImagePathError(imageDir) >ImagePathError: Image path does not exist or cannot be accessed/created: ('/rhev/data-center/32dab0ff-9eaa-41c7-ae50-4e6ef6355512/831ef374-8947-47f2-938f-5ec938f4fcef/images/8f3f3871-6aab-4f26-811f-c8e1803414fd',) >Thread-48::DEBUG::2014-06-04 15:17:27,727::resourceManager::210::ResourceManager.Request::(cancel) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`10f6af6b-164c-4dbb-ba35-c6e28ea2c7e5`::Canceled request >Thread-48::WARNING::2014-06-04 15:17:27,727::resourceManager::203::ResourceManager.Request::(cancel) ResName=`831ef374-8947-47f2-938f-5ec938f4fcef_imageNS.8f3f3871-6aab-4f26-811f-c8e1803414fd`ReqID=`10f6af6b-164c-4dbb-ba35-c6e28ea2c7e5`::Tried to cancel a processed request >Thread-48::ERROR::2014-06-04 15:17:27,728::task::866::TaskManager.Task::(_setError) Task=`ff072163-06ce-4149-b375-17e8e3375189`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 3171, in prepareVolume > imgUUID, lockType, timeout) > File "/usr/share/vdsm/storage/resourceManager.py", line 523, in acquireResource > raise se.ResourceAcqusitionFailed() >ResourceAcqusitionFailed: Could not acquire resource. Probably resource factory threw an exception.: () >Thread-48::DEBUG::2014-06-04 15:17:27,728::task::885::TaskManager.Task::(_run) Task=`ff072163-06ce-4149-b375-17e8e3375189`::Task._run: ff072163-06ce-4149-b375-17e8e3375189 ('831ef374-8947-47f2-938f-5ec938f4fcef', '32dab0ff-9eaa-41c7-ae50-4e6ef6355512', '8f3f3871-6aab-4f26-811f-c8e1803414fd', '81fbcbaf-2264-4fa8-831f-da5bf9b5281b', True) {} failed - stopping task >Thread-48::DEBUG::2014-06-04 15:17:27,728::task::1211::TaskManager.Task::(stop) Task=`ff072163-06ce-4149-b375-17e8e3375189`::stopping in state preparing (force False) >Thread-48::DEBUG::2014-06-04 15:17:27,728::task::990::TaskManager.Task::(_decref) Task=`ff072163-06ce-4149-b375-17e8e3375189`::ref 1 aborting True >Thread-48::INFO::2014-06-04 15:17:27,728::task::1168::TaskManager.Task::(prepare) Task=`ff072163-06ce-4149-b375-17e8e3375189`::aborting: Task is aborted: u'Could not acquire resource. Probably resource factory threw an exception.: ()' - code 100 >Thread-48::DEBUG::2014-06-04 15:17:27,728::task::1173::TaskManager.Task::(prepare) Task=`ff072163-06ce-4149-b375-17e8e3375189`::Prepare: aborted: Could not acquire resource. Probably resource factory threw an exception.: () >Thread-48::DEBUG::2014-06-04 15:17:27,728::task::990::TaskManager.Task::(_decref) Task=`ff072163-06ce-4149-b375-17e8e3375189`::ref 0 aborting True >Thread-48::DEBUG::2014-06-04 15:17:27,729::task::925::TaskManager.Task::(_doAbort) Task=`ff072163-06ce-4149-b375-17e8e3375189`::Task._doAbort: force False >Thread-48::DEBUG::2014-06-04 15:17:27,729::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-06-04 15:17:27,729::task::595::TaskManager.Task::(_updateState) Task=`ff072163-06ce-4149-b375-17e8e3375189`::moving from state preparing -> state aborting >Thread-48::DEBUG::2014-06-04 15:17:27,729::task::550::TaskManager.Task::(__state_aborting) Task=`ff072163-06ce-4149-b375-17e8e3375189`::_aborting: recover policy none >Thread-48::DEBUG::2014-06-04 15:17:27,729::task::595::TaskManager.Task::(_updateState) Task=`ff072163-06ce-4149-b375-17e8e3375189`::moving from state aborting -> state failed >Thread-48::DEBUG::2014-06-04 15:17:27,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.831ef374-8947-47f2-938f-5ec938f4fcef': < ResourceRef 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', isValid: 'True' obj: 'None'>} >Thread-48::DEBUG::2014-06-04 15:17:27,729::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-06-04 15:17:27,729::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' >Thread-48::DEBUG::2014-06-04 15:17:27,729::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' (0 active users) >Thread-48::DEBUG::2014-06-04 15:17:27,730::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef' is free, finding out if anyone is waiting for it. >Thread-48::DEBUG::2014-06-04 15:17:27,730::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.831ef374-8947-47f2-938f-5ec938f4fcef', Clearing records. >Thread-48::ERROR::2014-06-04 15:17:27,730::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': 'Could not acquire resource. Probably resource factory threw an exception.: ()', 'code': 855}} >Thread-28::DEBUG::2014-06-04 15:17:35,857::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:17:35,863::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102807 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:17:45,868::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:17:45,874::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111109 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:17:55,877::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:17:55,883::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107436 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:18:05,887::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:18:05,893::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0011058 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:18:15,896::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:18:15,902::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110187 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:18:25,906::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:18:25,912::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111336 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:18:35,915::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:18:35,921::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108176 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:18:45,925::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:18:45,931::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110314 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:18:55,934::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:18:55,940::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109292 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:05,944::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:05,950::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00111253 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:15,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:15,960::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109596 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:25,963::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:25,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102451 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:35,973::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:35,979::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112151 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:45,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:45,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110749 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:55,991::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 15:19:55,991::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:19:55,992::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:55,997::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000821343 s, 2.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:55,997::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000821343 s, 2.5 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 15:19:55,997::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 15:19:55,998::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 15:19:55,998::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:19:55,998::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:19:55,998::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:19:55,998::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:19:55,998::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:19:55,999::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:19:55,999::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:56,118::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:56,119::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:19:56,119::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 15:19:56,119::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 15:19:56,119::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 15:19:56,120::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 15:19:56,120::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:56,225::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:19:56,227::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:19:56,233::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000970613 s, 4.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:20:06,237::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:20:06,243::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114483 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:20:16,250::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:20:16,256::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102125 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:20:26,260::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:20:26,266::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112342 s, 3.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:20:36,269::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:20:36,275::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100223 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:20:46,279::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:20:46,285::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00133099 s, 3.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:20:56,289::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:20:56,295::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00121462 s, 3.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:21:06,298::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:21:06,304::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0012285 s, 3.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:21:16,308::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:21:16,314::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010176 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:21:26,317::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:21:26,323::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102644 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:21:36,327::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:21:36,333::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101558 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:21:46,336::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:21:46,342::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010283 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:21:56,346::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:21:56,352::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010091 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:22:06,355::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:22:06,361::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101591 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:22:16,365::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:22:16,371::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101533 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:22:26,375::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:22:26,381::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105041 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:22:36,384::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:22:36,390::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101951 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:22:46,394::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:22:46,400::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102308 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:22:56,404::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:22:56,410::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101605 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:23:06,413::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:23:06,419::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996035 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:23:16,423::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:23:16,429::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101375 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:23:26,432::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:23:26,438::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100622 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:23:36,442::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:23:36,448::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101307 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:23:46,452::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:23:46,458::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100409 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:23:56,461::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:23:56,467::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994641 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:06,471::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:06,477::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100771 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:16,480::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:16,486::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010845 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:26,490::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:26,496::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101562 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:36,499::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:36,505::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105381 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:46,509::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:46,515::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106788 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:56,517::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 831ef374-8947-47f2-938f-5ec938f4fcef >Thread-28::DEBUG::2014-06-04 15:24:56,517::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:24:56,519::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:56,523::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000836778 s, 2.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:56,524::misc::287::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000836778 s, 2.4 MB/s'], size: 2048 >Thread-28::DEBUG::2014-06-04 15:24:56,524::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-28::WARNING::2014-06-04 15:24:56,524::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-28::DEBUG::2014-06-04 15:24:56,524::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-28::DEBUG::2014-06-04 15:24:56,524::lvm::502::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:24:56,524::lvm::504::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:24:56,525::lvm::512::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:24:56,525::lvm::524::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:24:56,525::lvm::372::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-28::DEBUG::2014-06-04 15:24:56,525::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:56,637::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:56,638::lvm::414::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-28::DEBUG::2014-06-04 15:24:56,638::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'PHYBLKSIZE=4096', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'DESCRIPTION=hosted_storage', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=wo4tSr-rK0r-P1fC-VoWW-G852-U9OQ-r2mHrY', u'PV0=pv:33000000100000001,uuid:TALxve-i9Ju-sw7s-yTN8-eMGC-mYbT-qqFcnr,pestart:0,pecount:388,mapoffset:0', 'CLASS=Data', 'SDUUID=831ef374-8947-47f2-938f-5ec938f4fcef', 'LOCKPOLICY=ON', 'MASTER_VERSION=1', 'POOL_DOMAINS=831ef374-8947-47f2-938f-5ec938f4fcef:Active', 'POOL_DESCRIPTION=hosted_datacenter', 'ROLE=Master', 'POOL_UUID=32dab0ff-9eaa-41c7-ae50-4e6ef6355512', 'POOL_SPM_LVER=0', 'POOL_SPM_ID=-1', '_SHA_CKSUM=bbe791f83749c36e25a8eb2f9ff42d4f9907e537'] >Thread-28::INFO::2014-06-04 15:24:56,639::sd::374::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_imageNS already registered >Thread-28::INFO::2014-06-04 15:24:56,639::sd::382::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_volumeNS already registered >Thread-28::INFO::2014-06-04 15:24:56,639::blockSD::456::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 831ef374-8947-47f2-938f-5ec938f4fcef_lvmActivationNS already registered >Thread-28::DEBUG::2014-06-04 15:24:56,640::lvm::295::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/33000000100000001|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 } backup { retain_min = 50 retain_days = 0 } " 831ef374-8947-47f2-938f-5ec938f4fcef' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:56,753::lvm::295::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:24:56,754::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:24:56,760::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000988381 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:25:06,765::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:25:06,771::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00110655 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:25:16,774::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:25:16,780::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103655 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:25:26,784::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:25:26,789::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102176 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:25:36,793::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:25:36,799::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000989866 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:25:46,802::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:25:46,808::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00098848 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:25:56,812::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:25:56,818::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102273 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:26:06,822::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:26:06,828::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102707 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:26:16,831::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:26:16,837::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010165 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:26:26,841::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:26:26,847::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101801 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:26:36,850::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:26:36,856::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103947 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:26:46,860::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:26:46,866::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100602 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:26:56,869::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:26:56,875::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104907 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:27:06,879::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:27:06,884::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102534 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:27:16,888::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:27:16,894::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100062 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:27:26,897::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:27:26,903::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000990744 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:27:36,907::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:27:36,913::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010027 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:27:46,916::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:27:46,922::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100136 s, 4.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:27:56,925::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:27:56,932::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00108141 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:28:06,935::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:28:06,941::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106292 s, 3.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:28:16,944::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:28:16,950::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00106651 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:28:26,954::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:28:26,960::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010935 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:28:36,963::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:28:36,969::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103003 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:28:46,973::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:28:46,979::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109206 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:28:56,982::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:28:56,988::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00101627 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:29:06,992::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:29:06,998::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109985 s, 3.7 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:29:17,001::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:29:17,007::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00102543 s, 4.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:29:27,011::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:29:27,017::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107047 s, 3.8 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-06-04 15:29:37,020::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd iflag=direct if=/dev/831ef374-8947-47f2-938f-5ec938f4fcef/metadata bs=4096 count=1' (cwd None) >Thread-28::DEBUG::2014-06-04 15:29:37,026::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000960729 s, 4.3 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1104672
: 902185