Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 937651 Details for
Bug 1141850
Unhandled SSLError in MultiProtocolAcceptor
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm log
vdsm.log (text/plain), 595.86 KB, created by
Nir Soffer
on 2014-09-15 15:22:02 UTC
(
hide
)
Description:
vdsm log
Filename:
MIME Type:
Creator:
Nir Soffer
Created:
2014-09-15 15:22:02 UTC
Size:
595.86 KB
patch
obsolete
>MainThread::INFO::2014-09-15 18:10:19,602::vdsm::136::vds::(run) (PID: 14809) I am the actual vdsm 4.16.0-307.git04bd21c.el7 reserved-0-247.tlv.redhat.com (3.10.0-123.6.3.el7.x86_64) >MainThread::DEBUG::2014-09-15 18:10:19,602::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-09-15 18:10:19,602::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500 >MainThread::DEBUG::2014-09-15 18:10:19,605::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt >MainThread::WARNING::2014-09-15 18:10:19,605::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-09-15 18:10:19,606::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping >MainThread::DEBUG::2014-09-15 18:10:19,629::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-09-15 18:10:19,634::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-09-15 18:10:19,634::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /usr/sbin/lvm dumpconfig global/locking_type (cwd None) >MainThread::DEBUG::2014-09-15 18:10:19,651::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-09-15 18:10:19,652::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-09-15 18:10:19,653::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-09-15 18:10:19,653::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-09-15 18:10:19,653::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-09-15 18:10:19,654::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-09-15 18:10:19,654::misc::743::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-09-15 18:10:19,655::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-09-15 18:10:19,655::misc::746::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-09-15 18:10:19,665::misc::743::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-09-15 18:10:19,665::misc::746::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-09-15 18:10:19,665::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-09-15 18:10:19,666::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >storageRefresh::DEBUG::2014-09-15 18:10:19,686::misc::753::Storage.SamplingMethod::(__call__) Returning last result >MainThread::DEBUG::2014-09-15 18:10:19,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc763dfe-6ab6-4b16-933b-5895460e9c71`::moving from state init -> state preparing >MainThread::INFO::2014-09-15 18:10:19,701::logUtils::48::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0xf8ecd0>>) >MainThread::INFO::2014-09-15 18:10:19,701::logUtils::51::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-09-15 18:10:19,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc763dfe-6ab6-4b16-933b-5895460e9c71`::finished: None >MainThread::DEBUG::2014-09-15 18:10:19,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc763dfe-6ab6-4b16-933b-5895460e9c71`::moving from state preparing -> state finished >MainThread::DEBUG::2014-09-15 18:10:19,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-09-15 18:10:19,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >storageRefresh::DEBUG::2014-09-15 18:10:19,701::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >MainThread::DEBUG::2014-09-15 18:10:19,701::task::993::Storage.TaskManager.Task::(_decref) Task=`dc763dfe-6ab6-4b16-933b-5895460e9c71`::ref 0 aborting False >MainThread::INFO::2014-09-15 18:10:19,704::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-09-15 18:10:19,707::vmchannels::195::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-09-15 18:10:19,710::vmchannels::178::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-09-15 18:10:19,717::libvirtconnection::150::root::(get) trying to connect libvirt >MainThread::DEBUG::2014-09-15 18:10:19,718::protocoldetector::148::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x15ec998> >storageRefresh::DEBUG::2014-09-15 18:10:19,718::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-09-15 18:10:19,722::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,724::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,724::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,727::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,728::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,728::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,730::misc::753::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-09-15 18:10:19,731::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >MainThread::DEBUG::2014-09-15 18:10:19,774::protocoldetector::148::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x1724b48> >JsonRpcServer::DEBUG::2014-09-15 18:10:19,775::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-09-15 18:10:19,777::protocoldetector::87::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running >Detector thread::DEBUG::2014-09-15 18:10:19,777::protocoldetector::89::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=11 >storageRefresh::DEBUG::2014-09-15 18:10:19,788::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None) >storageRefresh::DEBUG::2014-09-15 18:10:19,809::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060008 was disabled\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060005 was disabled\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060006 was disabled\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060001 was disabled\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-15 18:10:19,810::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,811::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,812::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-09-15 18:10:19,836::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060008 was disabled\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060005 was disabled\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060006 was disabled\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060001 was disabled\n No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-15 18:10:19,837::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,838::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None) >storageRefresh::DEBUG::2014-09-15 18:10:19,859::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060008 was disabled\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060005 was disabled\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060006 was disabled\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060001 was disabled\n No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-15 18:10:19,859::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,860::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-09-15 18:10:19,878::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060008 was disabled\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060005 was disabled\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060006 was disabled\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060001 was disabled\n No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-09-15 18:10:19,879::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-09-15 18:10:19,879::hsm::387::Storage.HSM::(storageRefresh) HSM is ready >Detector thread::ERROR::2014-09-15 18:11:03,634::protocoldetector::98::vds.MultiProtocolAcceptor::(serve_forever) Unhandled exception >Traceback (most recent call last): > File "/usr/share/vdsm/protocoldetector.py", line 94, in serve_forever > self._process_events() > File "/usr/share/vdsm/protocoldetector.py", line 111, in _process_events > self._accept_connection() > File "/usr/share/vdsm/protocoldetector.py", line 174, in _accept_connection > client_socket, _ = self._socket.accept() > File "/usr/lib64/python2.7/site-packages/vdsm/sslutils.py", line 121, in accept > raise SSL.SSLError("%s, client %s" % (e, address[0])) >SSLError: unexpected eof, client 10.35.0.141 >Detector thread::DEBUG::2014-09-15 18:14:35,473::protocoldetector::179::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:37957 >Detector thread::DEBUG::2014-09-15 18:14:35,474::protocoldetector::190::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:37957 >Detector thread::DEBUG::2014-09-15 18:14:35,474::protocoldetector::216::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:37957 >Detector thread::DEBUG::2014-09-15 18:14:35,475::BindingXMLRPC::1189::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 37957) >Thread-13::DEBUG::2014-09-15 18:14:35,476::BindingXMLRPC::1149::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-13::DEBUG::2014-09-15 18:14:35,503::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,514::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,514::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,525::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,526::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,534::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,535::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,543::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,544::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,551::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,552::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,560::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,561::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,569::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,570::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mgKV85FyRg2kidu/bonding/mode (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,578::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,579::utils::594::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,599::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,609::utils::594::root::(execCmd) numactl --hardware (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,613::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,613::utils::594::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None) >Thread-13::DEBUG::2014-09-15 18:14:35,616::utils::614::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-09-15 18:14:35,618::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled >Thread-13::DEBUG::2014-09-15 18:14:35,619::BindingXMLRPC::1156::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:967c8712f0f9'}], 'FC': []}, 'packages2': {'kernel': {'release': '123.6.3.el7.x86_64', 'buildtime': 1405512646.0, 'version': '3.10.0'}, 'spice-server': {'release': '5.el7', 'buildtime': 1391017388L, 'version': '0.12.4'}, 'vdsm': {'release': '307.git04bd21c.el7', 'buildtime': 1410793375L, 'version': '4.16.0'}, 'qemu-kvm': {'release': '60.el7_0.2', 'buildtime': 1408576097L, 'version': '1.5.3'}, 'libvirt': {'release': '29.el7_0.1', 'buildtime': 1404387754L, 'version': '1.1.1'}, 'qemu-img': {'release': '60.el7_0.2', 'buildtime': 1408576097L, 'version': '1.5.3'}, 'mom': {'release': '1.el7', 'buildtime': 1403270463L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.226', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe58:6789/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.226/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.226', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe58:6789/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.226/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0'], 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '116', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.525400586789', 'bridge_id': '8000.525400586789', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '4357', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '0'}}}, 'uuid': '77A14806-F954-4D2A-AEA6-C098A4469927', 'lastClientIface': 'lo', 'nics': {'eth0': {'addr': '', 'ipv6gateway': '::', 'ipv6addrs': ['fe80::5054:ff:fe58:6789/64'], 'mtu': '1500', 'bootproto4': 'none', 'netmask': '', 'ipv4addrs': [], 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:58:67:89', 'BOOTPROTO': 'none', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'hwaddr': '52:54:00:58:67:89', 'speed': 0, 'gateway': ''}}, 'software_revision': '307', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,nopl,nonstop_tsc,eagerfpu,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:967c8712f0f9', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 0, 'reservedMem': '321', 'bondings': {'bond0': {'ipv4addrs': [], 'addr': '', 'cfg': {'BOOTPROTO': 'none'}, 'ipv6addrs': [], 'mtu': '1500', 'bootproto4': 'none', 'netmask': '', 'slaves': [], 'hwaddr': 'be:a0:9f:3c:31:fc', 'ipv6gateway': '::', 'gateway': '', 'opts': {}}}, 'software_version': '4.16', 'memSize': '3695', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3695', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'pc', u'q35', u'rhel6.0.0', u'rhel6.1.0', u'rhel6.2.0', u'rhel6.3.0', u'rhel6.4.0', u'rhel6.5.0', u'none'], 'rngSources': ['random'], 'operatingSystem': {'release': '1.el7', 'version': '7.0', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-09-15 18:17:07,219::protocoldetector::179::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.0.141:56886 >Detector thread::DEBUG::2014-09-15 18:17:07,220::protocoldetector::190::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.0.141:56886 >Detector thread::DEBUG::2014-09-15 18:17:07,220::protocoldetector::216::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol stomp from 10.35.0.141:56886 >Detector thread::DEBUG::2014-09-15 18:17:07,221::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='CONNECT'> >Detector thread::INFO::2014-09-15 18:17:07,221::stompReactor::66::Broker.StompAdapter::(_cmd_connect) Processing CONNECT request >Detector thread::DEBUG::2014-09-15 18:17:07,221::stompReactor::338::protocoldetector.StompDetector::(handleSocket) Stomp detected from ('10.35.0.141', 56886) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:07,222::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SUBSCRIBE'> >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:07,222::stompReactor::89::Broker.StompAdapter::(_cmd_subscribe) Subscribe command ignored >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:07,262::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-14::DEBUG::2014-09-15 18:17:07,263::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getCapabilities' in bridge with {} >JsonRpcServer::DEBUG::2014-09-15 18:17:07,263::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-14::DEBUG::2014-09-15 18:17:07,276::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getCapabilities' in bridge with {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:967c8712f0f9'}], 'FC': []}, 'packages2': {'kernel': {'release': '123.6.3.el7.x86_64', 'buildtime': 1405512646.0, 'version': '3.10.0'}, 'spice-server': {'release': '5.el7', 'buildtime': 1391017388L, 'version': '0.12.4'}, 'vdsm': {'release': '307.git04bd21c.el7', 'buildtime': 1410793375L, 'version': '4.16.0'}, 'qemu-kvm': {'release': '60.el7_0.2', 'buildtime': 1408576097L, 'version': '1.5.3'}, 'libvirt': {'release': '29.el7_0.1', 'buildtime': 1404387754L, 'version': '1.1.1'}, 'qemu-img': {'release': '60.el7_0.2', 'buildtime': 1408576097L, 'version': '1.5.3'}, 'mom': {'release': '1.el7', 'buildtime': 1403270463L, 'version': '0.4.1'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.226', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe58:6789/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.226/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.226', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe58:6789/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.226/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0'], 'opts': {'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '1000', 'group_fwd_mask': '0x0', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3125', 'hello_timer': '149', 'multicast_querier_interval': '25500', 'max_age': '2000', 'hash_max': '512', 'stp_state': '0', 'topology_change_detected': '0', 'priority': '32768', 'multicast_membership_interval': '26000', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'nf_call_iptables': '0', 'topology_change': '0', 'hello_time': '200', 'root_id': '8000.525400586789', 'bridge_id': '8000.525400586789', 'topology_change_timer': '0', 'ageing_time': '30000', 'nf_call_ip6tables': '0', 'gc_timer': '1683', 'nf_call_arptables': '0', 'group_addr': '1:80:c2:0:0:0', 'multicast_last_member_interval': '100', 'multicast_query_interval': '12500', 'tcn_timer': '0', 'multicast_router': '1', 'vlan_filtering': '0', 'forward_delay': '0'}}}, 'uuid': '77A14806-F954-4D2A-AEA6-C098A4469927', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'addr': '', 'ipv6gateway': '::', 'ipv6addrs': ['fe80::5054:ff:fe58:6789/64'], 'mtu': '1500', 'bootproto4': 'none', 'netmask': '', 'ipv4addrs': [], 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:58:67:89', 'BOOTPROTO': 'none', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'hwaddr': '52:54:00:58:67:89', 'speed': 0, 'gateway': ''}}, 'software_revision': '307', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,nopl,nonstop_tsc,eagerfpu,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:967c8712f0f9', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 0, 'reservedMem': '321', 'bondings': {'bond0': {'ipv4addrs': [], 'addr': '', 'cfg': {'BOOTPROTO': 'none'}, 'ipv6addrs': [], 'mtu': '1500', 'bootproto4': 'none', 'netmask': '', 'slaves': [], 'hwaddr': 'be:a0:9f:3c:31:fc', 'ipv6gateway': '::', 'gateway': '', 'opts': {}}}, 'software_version': '4.16', 'memSize': '3695', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3695', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'pc', u'q35', u'rhel6.0.0', u'rhel6.1.0', u'rhel6.2.0', u'rhel6.3.0', u'rhel6.4.0', u'rhel6.5.0', u'none'], 'rngSources': ['random'], 'operatingSystem': {'release': '1.el7', 'version': '7.0', 'name': 'RHEL'}} >Thread-14::DEBUG::2014-09-15 18:17:07,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:07,343::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-15::DEBUG::2014-09-15 18:17:07,344::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getHardwareInfo' in bridge with {} >JsonRpcServer::DEBUG::2014-09-15 18:17:07,344::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-15::DEBUG::2014-09-15 18:17:07,367::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getHardwareInfo' in bridge with {'systemProductName': 'Bochs', 'systemUUID': '77a14806-f954-4d2a-aea6-c098a4469927', 'systemManufacturer': 'Bochs'} >Thread-15::DEBUG::2014-09-15 18:17:07,368::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:07,430::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:07,430::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-16::DEBUG::2014-09-15 18:17:07,431::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:07,465::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-17::DEBUG::2014-09-15 18:17:07,466::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connectStorageServer' in bridge with {u'connectionParams': [{u'id': u'e8d58651-6414-4fc2-b281-2141cc97829b', u'connection': u'10.35.0.98', u'iqn': u'iqn.1994-05.com.redhat:target6', u'user': u'', u'tpgt': u'1', u'password': u'', u'port': u'3260'}], u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e', u'domainType': 3} >JsonRpcServer::DEBUG::2014-09-15 18:17:07,466::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-09-15 18:17:07,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9b97c9-5448-4eef-b019-3633a16e4cda`::moving from state init -> state preparing >Thread-17::INFO::2014-09-15 18:17:07,467::logUtils::48::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', conList=[{u'connection': u'10.35.0.98', u'iqn': u'iqn.1994-05.com.redhat:target6', u'user': u'', u'tpgt': u'1', u'password': '******', u'id': u'e8d58651-6414-4fc2-b281-2141cc97829b', u'port': u'3260'}], options=None) >Thread-17::DEBUG::2014-09-15 18:17:07,467::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 --op=new (cwd None) >Thread-17::DEBUG::2014-09-15 18:17:07,478::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-09-15 18:17:07,479::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -l (cwd None) >Thread-17::DEBUG::2014-09-15 18:17:08,023::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-09-15 18:17:08,024::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -n node.startup -v manual --op=update (cwd None) >Thread-17::DEBUG::2014-09-15 18:17:08,036::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-09-15 18:17:08,036::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-17::DEBUG::2014-09-15 18:17:08,037::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-17::DEBUG::2014-09-15 18:17:08,064::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060008: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060008 was disabled\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060005: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060005 was disabled\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060006: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060006 was disabled\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474770944: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 21474828288: Input/output error\n /dev/mapper/1IET_00060001: read failed after 0 of 4096 at 0: Input/output error\n WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060001 was disabled\n No volume groups found\n'; <rc> = 0 >Thread-17::DEBUG::2014-09-15 18:17:08,065::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-17::DEBUG::2014-09-15 18:17:08,065::hsm::2415::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-17::DEBUG::2014-09-15 18:17:08,065::hsm::2471::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-17::INFO::2014-09-15 18:17:08,065::logUtils::51::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'e8d58651-6414-4fc2-b281-2141cc97829b'}]} >Thread-17::DEBUG::2014-09-15 18:17:08,065::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe9b97c9-5448-4eef-b019-3633a16e4cda`::finished: {'statuslist': [{'status': 0, 'id': u'e8d58651-6414-4fc2-b281-2141cc97829b'}]} >Thread-17::DEBUG::2014-09-15 18:17:08,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe9b97c9-5448-4eef-b019-3633a16e4cda`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-09-15 18:17:08,066::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-09-15 18:17:08,066::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-09-15 18:17:08,066::task::993::Storage.TaskManager.Task::(_decref) Task=`fe9b97c9-5448-4eef-b019-3633a16e4cda`::ref 0 aborting False >Thread-17::DEBUG::2014-09-15 18:17:08,066::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connectStorageServer' in bridge with [{'status': 0, 'id': u'e8d58651-6414-4fc2-b281-2141cc97829b'}] >Thread-17::DEBUG::2014-09-15 18:17:08,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:08,072::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:08,074::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-18::DEBUG::2014-09-15 18:17:08,074::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.connect' in bridge with {u'masterVersion': 1, u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e', u'scsiKey': u'b86b687a-d073-497a-ac8a-249025419a3e', u'masterSdUUID': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', u'hostID': 1} >Thread-18::DEBUG::2014-09-15 18:17:08,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`48515931-4ea6-443f-8a18-58c00486545a`::moving from state init -> state preparing >Thread-18::INFO::2014-09-15 18:17:08,076::logUtils::48::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', hostID=1, msdUUID=u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', masterVersion=1, domainsMap=None, options=None) >Thread-18::DEBUG::2014-09-15 18:17:08,076::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`224e7550-e741-44d9-93ae-4060bfffac5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-18::DEBUG::2014-09-15 18:17:08,076::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-18::DEBUG::2014-09-15 18:17:08,076::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-18::DEBUG::2014-09-15 18:17:08,077::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`224e7550-e741-44d9-93ae-4060bfffac5f`::Granted request >Thread-18::DEBUG::2014-09-15 18:17:08,077::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`9a78ec5a-9af4-4c63-8987-0f115c6de04d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool' >Thread-18::DEBUG::2014-09-15 18:17:08,077::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive' >Thread-18::DEBUG::2014-09-15 18:17:08,077::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user) >Thread-18::DEBUG::2014-09-15 18:17:08,078::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`9a78ec5a-9af4-4c63-8987-0f115c6de04d`::Granted request >Thread-18::INFO::2014-09-15 18:17:08,078::sp::133::Storage.StoragePool::(setBackend) updating pool b86b687a-d073-497a-ac8a-249025419a3e backend from type NoneType instance 0x7f69f2573f00 to type StoragePoolDiskBackend instance 0x7f699819bab8 >Thread-18::INFO::2014-09-15 18:17:08,078::sp::631::Storage.StoragePool::(connect) Connect host #1 to the storage pool b86b687a-d073-497a-ac8a-249025419a3e with master domain: b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (ver = 1) >Thread-18::DEBUG::2014-09-15 18:17:08,078::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,078::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,078::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,079::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,079::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,079::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,079::misc::743::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-18::DEBUG::2014-09-15 18:17:08,079::misc::746::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2014-09-15 18:17:08,079::misc::743::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-18::DEBUG::2014-09-15 18:17:08,079::misc::746::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2014-09-15 18:17:08,079::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-18::DEBUG::2014-09-15 18:17:08,079::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /usr/sbin/iscsiadm -m session -R (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,143::misc::753::Storage.SamplingMethod::(__call__) Returning last result >Thread-18::DEBUG::2014-09-15 18:17:08,145::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /usr/sbin/multipath (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,172::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,172::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,172::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,172::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,172::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,173::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,173::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,173::misc::753::Storage.SamplingMethod::(__call__) Returning last result >Thread-18::ERROR::2014-09-15 18:17:08,173::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-18::ERROR::2014-09-15 18:17:08,173::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-18::DEBUG::2014-09-15 18:17:08,174::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,179::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,302::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,302::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,302::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-09-15 18:17:08,302::blockSD::336::Storage.Misc.excCmd::(readlines) /usr/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata count=1 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,308::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00149673 s, 1.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,308::misc::261::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00149673 s, 1.4 MB/s'], size: 2048 >Thread-18::DEBUG::2014-09-15 18:17:08,308::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::DEBUG::2014-09-15 18:17:08,308::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-18::DEBUG::2014-09-15 18:17:08,309::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-09-15 18:17:08,309::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,309::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,309::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,309::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,310::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,310::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,376::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,376::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,377::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=-1', '_SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd'] >Thread-18::DEBUG::2014-09-15 18:17:08,377::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1_imageNS' >Thread-18::DEBUG::2014-09-15 18:17:08,377::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1_volumeNS' >Thread-18::DEBUG::2014-09-15 18:17:08,377::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1_lvmActivationNS' >Thread-18::DEBUG::2014-09-15 18:17:08,378::sp::1389::Storage.StoragePool::(setMasterDomain) Master domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 verified, version 1 >Thread-18::DEBUG::2014-09-15 18:17:08,378::misc::743::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-18::DEBUG::2014-09-15 18:17:08,378::misc::746::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-18::DEBUG::2014-09-15 18:17:08,378::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,378::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,378::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,378::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,378::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,378::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,444::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,444::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,444::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=-1', '_SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd'] >Thread-18::INFO::2014-09-15 18:17:08,444::domainMonitor::103::Storage.DomainMonitor::(startMonitoring) Start monitoring b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-19::DEBUG::2014-09-15 18:17:08,445::domainMonitor::205::Storage.DomainMonitorThread::(_run) Starting domain monitor for b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-18::INFO::2014-09-15 18:17:08,445::domainMonitor::103::Storage.DomainMonitor::(startMonitoring) Start monitoring aa740243-00c8-498a-a94a-f8330738e5b9 >Thread-20::DEBUG::2014-09-15 18:17:08,446::domainMonitor::205::Storage.DomainMonitorThread::(_run) Starting domain monitor for aa740243-00c8-498a-a94a-f8330738e5b9 >Thread-19::DEBUG::2014-09-15 18:17:08,446::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-20::ERROR::2014-09-15 18:17:08,447::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain aa740243-00c8-498a-a94a-f8330738e5b9 >Thread-18::DEBUG::2014-09-15 18:17:08,446::misc::753::Storage.SamplingMethod::(__call__) Returning last result >Thread-20::ERROR::2014-09-15 18:17:08,447::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain aa740243-00c8-498a-a94a-f8330738e5b9 >Thread-20::DEBUG::2014-09-15 18:17:08,451::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,451::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e >Thread-20::DEBUG::2014-09-15 18:17:08,451::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name aa740243-00c8-498a-a94a-f8330738e5b9 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,456::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-19::DEBUG::2014-09-15 18:17:08,473::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:17:08,473::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:17:08,477::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00061659 s, 6.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:08,519::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:08,520::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,520::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-09-15 18:17:08,520::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,521::blockSD::336::Storage.Misc.excCmd::(readlines) /usr/bin/dd iflag=direct skip=0 bs=2048 if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata count=1 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,521::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,525::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,525::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,525::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,525::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000552761 s, 3.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:08,526::misc::261::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000552761 s, 3.7 MB/s'], size: 2048 >Thread-18::DEBUG::2014-09-15 18:17:08,526::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:08,526::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-20::DEBUG::2014-09-15 18:17:08,529::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >Thread-20::DEBUG::2014-09-15 18:17:08,530::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-20::DEBUG::2014-09-15 18:17:08,530::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-18::DEBUG::2014-09-15 18:17:08,592::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,592::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,593::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,593::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=-1', '_SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd'] >Thread-20::DEBUG::2014-09-15 18:17:08,593::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,594::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,595::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm invalidate operation' is holding the operation mutex, waiting... >Thread-20::DEBUG::2014-09-15 18:17:08,595::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-09-15 18:17:08,596::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,597::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-18::DEBUG::2014-09-15 18:17:08,598::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name aa740243-00c8-498a-a94a-f8330738e5b9 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:08,599::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name aa740243-00c8-498a-a94a-f8330738e5b9 (cwd None) >Thread-19::DEBUG::2014-09-15 18:17:08,607::domainMonitor::275::Storage.DomainMonitorThread::(_notifyStatusChanges) Domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 changed its status to Valid >Thread-21::DEBUG::2014-09-15 18:17:08,607::misc::823::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-19::INFO::2014-09-15 18:17:08,608::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (id: 1) >Thread-21::DEBUG::2014-09-15 18:17:08,608::misc::833::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-19::DEBUG::2014-09-15 18:17:08,608::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 successfully acquired (id: 1) >Thread-21::DEBUG::2014-09-15 18:17:08,609::misc::843::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-22::INFO::2014-09-15 18:17:08,610::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >Thread-18::DEBUG::2014-09-15 18:17:08,670::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,671::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/aa740243-00c8-498a-a94a-f8330738e5b9/dom_md >Thread-18::WARNING::2014-09-15 18:17:08,671::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/aa740243-00c8-498a-a94a-f8330738e5b9/dom_md already exists >Thread-18::DEBUG::2014-09-15 18:17:08,671::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/aa740243-00c8-498a-a94a-f8330738e5b9/images >Thread-18::WARNING::2014-09-15 18:17:08,671::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/aa740243-00c8-498a-a94a-f8330738e5b9/images already exists >Thread-18::INFO::2014-09-15 18:17:08,671::sp::1119::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/aa740243-00c8-498a-a94a-f8330738e5b9 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/aa740243-00c8-498a-a94a-f8330738e5b9 >Thread-18::DEBUG::2014-09-15 18:17:08,672::sp::1136::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/aa740243-00c8-498a-a94a-f8330738e5b9 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/aa740243-00c8-498a-a94a-f8330738e5b9 >Thread-18::DEBUG::2014-09-15 18:17:08,672::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/images >Thread-18::WARNING::2014-09-15 18:17:08,672::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/images already exists >Thread-18::DEBUG::2014-09-15 18:17:08,672::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/dom_md >Thread-18::WARNING::2014-09-15 18:17:08,672::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/dom_md already exists >Thread-18::INFO::2014-09-15 18:17:08,672::sp::1119::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-18::DEBUG::2014-09-15 18:17:08,672::sp::1136::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-18::INFO::2014-09-15 18:17:08,672::sp::1119::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd >Thread-18::DEBUG::2014-09-15 18:17:08,672::sp::1136::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd >Thread-18::DEBUG::2014-09-15 18:17:08,673::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500 >Thread-18::DEBUG::2014-09-15 18:17:08,674::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:08,677::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:08,678::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-20::DEBUG::2014-09-15 18:17:08,678::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'PHYBLKSIZE=512', 'SDUUID=aa740243-00c8-498a-a94a-f8330738e5b9', 'DESCRIPTION=jumbo-58', 'CLASS=Data', 'LOCKPOLICY=', u'PV0=pv:1IET_00060008,uuid:KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU,pestart:0,pecount:157,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', '_SHA_CKSUM=ac63e3c0c89a8ccd4884d41c6c47dbc0b98a3d97', 'MASTER_VERSION=0'] >Thread-20::DEBUG::2014-09-15 18:17:08,678::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'aa740243-00c8-498a-a94a-f8330738e5b9_imageNS' >Thread-20::DEBUG::2014-09-15 18:17:08,678::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'aa740243-00c8-498a-a94a-f8330738e5b9_volumeNS' >Thread-20::DEBUG::2014-09-15 18:17:08,679::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'aa740243-00c8-498a-a94a-f8330738e5b9_lvmActivationNS' >Thread-20::DEBUG::2014-09-15 18:17:08,679::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060008|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' aa740243-00c8-498a-a94a-f8330738e5b9 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,682::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00303736 s, 1.3 MB/s\n'; <rc> = 0 >Thread-18::INFO::2014-09-15 18:17:08,682::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/usr/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-18::DEBUG::2014-09-15 18:17:08,682::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /usr/bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8 (cwd None) >Thread-18::DEBUG::2014-09-15 18:17:08,690::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00430632 s, 951 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-09-15 18:17:08,691::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool b86b687a-d073-497a-ac8a-249025419a3e >Thread-18::DEBUG::2014-09-15 18:17:08,691::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool b86b687a-d073-497a-ac8a-249025419a3e on master domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >Thread-18::DEBUG::2014-09-15 18:17:08,691::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-18::DEBUG::2014-09-15 18:17:08,691::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-18::DEBUG::2014-09-15 18:17:08,691::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-09-15 18:17:08,691::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-18::DEBUG::2014-09-15 18:17:08,692::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-18::DEBUG::2014-09-15 18:17:08,692::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-18::DEBUG::2014-09-15 18:17:08,692::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-18::DEBUG::2014-09-15 18:17:08,692::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-18::INFO::2014-09-15 18:17:08,692::logUtils::51::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-18::DEBUG::2014-09-15 18:17:08,692::task::1191::Storage.TaskManager.Task::(prepare) Task=`48515931-4ea6-443f-8a18-58c00486545a`::finished: True >Thread-18::DEBUG::2014-09-15 18:17:08,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`48515931-4ea6-443f-8a18-58c00486545a`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-09-15 18:17:08,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-09-15 18:17:08,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-09-15 18:17:08,692::task::993::Storage.TaskManager.Task::(_decref) Task=`48515931-4ea6-443f-8a18-58c00486545a`::ref 0 aborting False >Thread-18::DEBUG::2014-09-15 18:17:08,692::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.connect' in bridge with True >Thread-18::DEBUG::2014-09-15 18:17:08,693::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:08,696::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:08,697::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-29::DEBUG::2014-09-15 18:17:08,698::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dff3ddb-83b7-4eab-a5cb-0cc13566f33b`::moving from state init -> state preparing >Thread-29::INFO::2014-09-15 18:17:08,699::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-29::INFO::2014-09-15 18:17:08,699::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00061659', 'lastCheck': '0.1', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.3', 'valid': True}} >Thread-29::DEBUG::2014-09-15 18:17:08,699::task::1191::Storage.TaskManager.Task::(prepare) Task=`8dff3ddb-83b7-4eab-a5cb-0cc13566f33b`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00061659', 'lastCheck': '0.1', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.3', 'valid': True}} >Thread-29::DEBUG::2014-09-15 18:17:08,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`8dff3ddb-83b7-4eab-a5cb-0cc13566f33b`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-09-15 18:17:08,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2014-09-15 18:17:08,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-09-15 18:17:08,699::task::993::Storage.TaskManager.Task::(_decref) Task=`8dff3ddb-83b7-4eab-a5cb-0cc13566f33b`::ref 0 aborting False >Thread-29::DEBUG::2014-09-15 18:17:08,700::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:17:08,706::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:08,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:08,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054888 s, 7.5 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:08,711::domainMonitor::275::Storage.DomainMonitorThread::(_notifyStatusChanges) Domain aa740243-00c8-498a-a94a-f8330738e5b9 changed its status to Valid >Thread-30::DEBUG::2014-09-15 18:17:08,711::misc::823::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-20::INFO::2014-09-15 18:17:08,711::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain aa740243-00c8-498a-a94a-f8330738e5b9 (id: 1) >Thread-30::DEBUG::2014-09-15 18:17:08,712::misc::833::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-20::DEBUG::2014-09-15 18:17:08,712::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain aa740243-00c8-498a-a94a-f8330738e5b9 successfully acquired (id: 1) >Thread-30::DEBUG::2014-09-15 18:17:08,713::misc::843::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-31::INFO::2014-09-15 18:17:08,713::clientIF::137::vds::(contEIOVms) vmContainerLock acquired >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:08,751::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:08,752::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-32::DEBUG::2014-09-15 18:17:08,752::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.setMOMPolicyParameters' in bridge with {u'key_value_store': {u'balloonEnabled': True, u'ksmEnabled': True}} >Thread-32::DEBUG::2014-09-15 18:17:08,789::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.setMOMPolicyParameters' in bridge with True >Thread-32::DEBUG::2014-09-15 18:17:08,790::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:11,923::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:11,924::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-33::DEBUG::2014-09-15 18:17:11,924::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:14,924::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-34::DEBUG::2014-09-15 18:17:14,924::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:17:14,924::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-34::DEBUG::2014-09-15 18:17:14,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`758b36a8-89d7-4052-afa0-2b7b13e8404a`::moving from state init -> state preparing >Thread-34::INFO::2014-09-15 18:17:14,925::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-34::INFO::2014-09-15 18:17:14,926::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-34::DEBUG::2014-09-15 18:17:14,926::task::1191::Storage.TaskManager.Task::(prepare) Task=`758b36a8-89d7-4052-afa0-2b7b13e8404a`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0}} >Thread-34::DEBUG::2014-09-15 18:17:14,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`758b36a8-89d7-4052-afa0-2b7b13e8404a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-09-15 18:17:14,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2014-09-15 18:17:14,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-09-15 18:17:14,926::task::993::Storage.TaskManager.Task::(_decref) Task=`758b36a8-89d7-4052-afa0-2b7b13e8404a`::ref 0 aborting False >Thread-34::DEBUG::2014-09-15 18:17:14,926::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': -1, 'spmStatus': 'Free', 'spmLver': 0} >Thread-34::DEBUG::2014-09-15 18:17:14,926::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:14,966::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:14,967::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-35::DEBUG::2014-09-15 18:17:14,967::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:14,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-36::DEBUG::2014-09-15 18:17:14,980::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.spmStart' in bridge with {u'maxHostID': 250, u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e', u'prevLver': u'0', u'enableScsiFencing': u'false', u'prevID': -1} >JsonRpcServer::DEBUG::2014-09-15 18:17:14,980::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-36::DEBUG::2014-09-15 18:17:14,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::moving from state init -> state preparing >Thread-36::INFO::2014-09-15 18:17:14,981::logUtils::48::dispatcher::(wrapper) Run and protect: spmStart(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', prevID=-1, prevLVER=u'0', maxHostID=250, domVersion=None, options=None) >Thread-36::DEBUG::2014-09-15 18:17:14,981::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`921e0055-a6d2-455a-a1ee-336665dec4aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '572' at 'spmStart' >Thread-36::DEBUG::2014-09-15 18:17:14,982::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive' >Thread-36::DEBUG::2014-09-15 18:17:14,982::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user) >Thread-36::DEBUG::2014-09-15 18:17:14,982::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`921e0055-a6d2-455a-a1ee-336665dec4aa`::Granted request >Thread-36::DEBUG::2014-09-15 18:17:14,982::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (exclusive) >Thread-36::DEBUG::2014-09-15 18:17:14,982::task::993::Storage.TaskManager.Task::(_decref) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::ref 1 aborting False >Thread-36::DEBUG::2014-09-15 18:17:14,982::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job spmStart for task 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-36::INFO::2014-09-15 18:17:14,982::logUtils::51::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-36::DEBUG::2014-09-15 18:17:14,982::task::1183::Storage.TaskManager.Task::(prepare) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::Prepare: 1 jobs exist, move to acquiring >Thread-36::DEBUG::2014-09-15 18:17:14,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::moving from state preparing -> state acquiring >Thread-36::DEBUG::2014-09-15 18:17:14,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::moving from state acquiring -> state queued >Thread-36::DEBUG::2014-09-15 18:17:14,982::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-9::DEBUG::2014-09-15 18:17:14,983::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 running: <bound method Task.commit of <storage.task.Task instance at 0x7f69980f1fc8>> with: None >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::task::1200::Storage.TaskManager.Task::(commit) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::committing task: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::moving from state queued -> state running >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::task::905::Storage.TaskManager.Task::(_runJobs) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f69980ca210>> (args: (-1, u'0', 250, None) kwargs: {}) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::task::331::Storage.TaskManager.Task::(run) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f69980ca210>> (args: (-1, u'0', 250, None) kwargs: {}) callback None >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::misc::743::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,983::misc::746::Storage.SamplingMethod::(__call__) Got in to sampling method >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,984::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,984::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,984::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,984::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,984::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:14,985::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-36::DEBUG::2014-09-15 18:17:14,988::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-36::DEBUG::2014-09-15 18:17:14,989::task::1188::Storage.TaskManager.Task::(prepare) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::returning >Thread-36::DEBUG::2014-09-15 18:17:14,989::task::993::Storage.TaskManager.Task::(_decref) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::ref 1 aborting False >Thread-36::DEBUG::2014-09-15 18:17:14,989::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.spmStart' in bridge with 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-36::DEBUG::2014-09-15 18:17:14,989::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:15,054::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:15,055::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:15,055::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=-1', '_SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:15,055::misc::753::Storage.SamplingMethod::(__call__) Returning last result >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::INFO::2014-09-15 18:17:15,055::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (id: 1) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:15,993::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-37::DEBUG::2014-09-15 18:17:15,993::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:15,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-37::DEBUG::2014-09-15 18:17:15,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`6045e1ea-724d-4bef-b138-3d5b57d4da15`::moving from state init -> state preparing >Thread-37::INFO::2014-09-15 18:17:15,995::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-37::DEBUG::2014-09-15 18:17:15,995::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-37::DEBUG::2014-09-15 18:17:15,995::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-37::INFO::2014-09-15 18:17:15,995::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-37::DEBUG::2014-09-15 18:17:15,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`6045e1ea-724d-4bef-b138-3d5b57d4da15`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-37::DEBUG::2014-09-15 18:17:15,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`6045e1ea-724d-4bef-b138-3d5b57d4da15`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-09-15 18:17:15,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-09-15 18:17:15,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-09-15 18:17:15,995::task::993::Storage.TaskManager.Task::(_decref) Task=`6045e1ea-724d-4bef-b138-3d5b57d4da15`::ref 0 aborting False >Thread-37::DEBUG::2014-09-15 18:17:15,995::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-37::DEBUG::2014-09-15 18:17:15,995::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:16,998::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:16,999::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-38::DEBUG::2014-09-15 18:17:16,999::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-38::DEBUG::2014-09-15 18:17:17,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`779570bb-2760-4353-a273-515733504f22`::moving from state init -> state preparing >Thread-38::INFO::2014-09-15 18:17:17,000::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-38::DEBUG::2014-09-15 18:17:17,000::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-38::DEBUG::2014-09-15 18:17:17,000::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-38::INFO::2014-09-15 18:17:17,000::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-38::DEBUG::2014-09-15 18:17:17,000::task::1191::Storage.TaskManager.Task::(prepare) Task=`779570bb-2760-4353-a273-515733504f22`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-38::DEBUG::2014-09-15 18:17:17,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`779570bb-2760-4353-a273-515733504f22`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-09-15 18:17:17,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-38::DEBUG::2014-09-15 18:17:17,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-09-15 18:17:17,000::task::993::Storage.TaskManager.Task::(_decref) Task=`779570bb-2760-4353-a273-515733504f22`::ref 0 aborting False >Thread-38::DEBUG::2014-09-15 18:17:17,000::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-38::DEBUG::2014-09-15 18:17:17,001::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:18,000::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:18,001::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-39::DEBUG::2014-09-15 18:17:18,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`f08c42a5-1254-461c-9dac-632db8a42fa9`::moving from state init -> state preparing >Thread-39::INFO::2014-09-15 18:17:18,002::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-39::INFO::2014-09-15 18:17:18,002::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00061659', 'lastCheck': '9.4', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00054888', 'lastCheck': '9.3', 'valid': True}} >Thread-39::DEBUG::2014-09-15 18:17:18,002::task::1191::Storage.TaskManager.Task::(prepare) Task=`f08c42a5-1254-461c-9dac-632db8a42fa9`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00061659', 'lastCheck': '9.4', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00054888', 'lastCheck': '9.3', 'valid': True}} >Thread-39::DEBUG::2014-09-15 18:17:18,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`f08c42a5-1254-461c-9dac-632db8a42fa9`::moving from state preparing -> state finished >Thread-39::DEBUG::2014-09-15 18:17:18,002::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-39::DEBUG::2014-09-15 18:17:18,002::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-39::DEBUG::2014-09-15 18:17:18,002::task::993::Storage.TaskManager.Task::(_decref) Task=`f08c42a5-1254-461c-9dac-632db8a42fa9`::ref 0 aborting False >Thread-39::DEBUG::2014-09-15 18:17:18,003::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:18,005::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:18,005::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-40::DEBUG::2014-09-15 18:17:18,005::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-40::DEBUG::2014-09-15 18:17:18,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`960fb91a-d2c4-4ddc-89bf-249774db01d4`::moving from state init -> state preparing >Thread-40::INFO::2014-09-15 18:17:18,006::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-40::DEBUG::2014-09-15 18:17:18,006::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-40::DEBUG::2014-09-15 18:17:18,006::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-40::INFO::2014-09-15 18:17:18,006::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-40::DEBUG::2014-09-15 18:17:18,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`960fb91a-d2c4-4ddc-89bf-249774db01d4`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-40::DEBUG::2014-09-15 18:17:18,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`960fb91a-d2c4-4ddc-89bf-249774db01d4`::moving from state preparing -> state finished >Thread-40::DEBUG::2014-09-15 18:17:18,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2014-09-15 18:17:18,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2014-09-15 18:17:18,007::task::993::Storage.TaskManager.Task::(_decref) Task=`960fb91a-d2c4-4ddc-89bf-249774db01d4`::ref 0 aborting False >Thread-40::DEBUG::2014-09-15 18:17:18,007::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-40::DEBUG::2014-09-15 18:17:18,007::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:18,012::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:18,012::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-41::DEBUG::2014-09-15 18:17:18,013::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-15 18:17:18,609::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:17:18,614::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000843116 s, 4.9 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:18,713::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:18,718::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000793023 s, 5.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:19,010::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-42::DEBUG::2014-09-15 18:17:19,011::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:19,011::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-42::DEBUG::2014-09-15 18:17:19,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`0968ef18-7a6f-4ff2-a73f-d4b3b0f2d92c`::moving from state init -> state preparing >Thread-42::INFO::2014-09-15 18:17:19,014::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-42::DEBUG::2014-09-15 18:17:19,015::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-42::DEBUG::2014-09-15 18:17:19,015::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-42::INFO::2014-09-15 18:17:19,015::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-42::DEBUG::2014-09-15 18:17:19,016::task::1191::Storage.TaskManager.Task::(prepare) Task=`0968ef18-7a6f-4ff2-a73f-d4b3b0f2d92c`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-42::DEBUG::2014-09-15 18:17:19,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`0968ef18-7a6f-4ff2-a73f-d4b3b0f2d92c`::moving from state preparing -> state finished >Thread-42::DEBUG::2014-09-15 18:17:19,016::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-42::DEBUG::2014-09-15 18:17:19,017::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-42::DEBUG::2014-09-15 18:17:19,017::task::993::Storage.TaskManager.Task::(_decref) Task=`0968ef18-7a6f-4ff2-a73f-d4b3b0f2d92c`::ref 0 aborting False >Thread-42::DEBUG::2014-09-15 18:17:19,017::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-42::DEBUG::2014-09-15 18:17:19,018::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:20,022::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-43::DEBUG::2014-09-15 18:17:20,022::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:20,022::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-43::DEBUG::2014-09-15 18:17:20,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`3281f187-b0ce-46d0-846e-345249128eab`::moving from state init -> state preparing >Thread-43::INFO::2014-09-15 18:17:20,024::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-43::DEBUG::2014-09-15 18:17:20,024::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-43::DEBUG::2014-09-15 18:17:20,024::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-43::INFO::2014-09-15 18:17:20,024::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-43::DEBUG::2014-09-15 18:17:20,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`3281f187-b0ce-46d0-846e-345249128eab`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-43::DEBUG::2014-09-15 18:17:20,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`3281f187-b0ce-46d0-846e-345249128eab`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-09-15 18:17:20,024::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-43::DEBUG::2014-09-15 18:17:20,024::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-09-15 18:17:20,024::task::993::Storage.TaskManager.Task::(_decref) Task=`3281f187-b0ce-46d0-846e-345249128eab`::ref 0 aborting False >Thread-43::DEBUG::2014-09-15 18:17:20,024::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-43::DEBUG::2014-09-15 18:17:20,024::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:21,027::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:21,028::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-44::DEBUG::2014-09-15 18:17:21,028::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-44::DEBUG::2014-09-15 18:17:21,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`1485d603-a71e-4fb1-bf37-2ca3c574de2c`::moving from state init -> state preparing >Thread-44::INFO::2014-09-15 18:17:21,029::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-44::DEBUG::2014-09-15 18:17:21,029::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-44::DEBUG::2014-09-15 18:17:21,029::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-44::INFO::2014-09-15 18:17:21,029::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-44::DEBUG::2014-09-15 18:17:21,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`1485d603-a71e-4fb1-bf37-2ca3c574de2c`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-44::DEBUG::2014-09-15 18:17:21,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`1485d603-a71e-4fb1-bf37-2ca3c574de2c`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-09-15 18:17:21,030::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-44::DEBUG::2014-09-15 18:17:21,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-09-15 18:17:21,030::task::993::Storage.TaskManager.Task::(_decref) Task=`1485d603-a71e-4fb1-bf37-2ca3c574de2c`::ref 0 aborting False >Thread-44::DEBUG::2014-09-15 18:17:21,030::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-44::DEBUG::2014-09-15 18:17:21,030::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:21,128::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:21,129::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-45::DEBUG::2014-09-15 18:17:21,130::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:22,033::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:22,033::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-46::DEBUG::2014-09-15 18:17:22,033::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-46::DEBUG::2014-09-15 18:17:22,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`210af75b-c454-47e2-8828-24f904d592da`::moving from state init -> state preparing >Thread-46::INFO::2014-09-15 18:17:22,034::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-46::DEBUG::2014-09-15 18:17:22,034::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-46::DEBUG::2014-09-15 18:17:22,034::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-46::INFO::2014-09-15 18:17:22,035::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-46::DEBUG::2014-09-15 18:17:22,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`210af75b-c454-47e2-8828-24f904d592da`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-46::DEBUG::2014-09-15 18:17:22,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`210af75b-c454-47e2-8828-24f904d592da`::moving from state preparing -> state finished >Thread-46::DEBUG::2014-09-15 18:17:22,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-46::DEBUG::2014-09-15 18:17:22,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-09-15 18:17:22,035::task::993::Storage.TaskManager.Task::(_decref) Task=`210af75b-c454-47e2-8828-24f904d592da`::ref 0 aborting False >Thread-46::DEBUG::2014-09-15 18:17:22,035::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-46::DEBUG::2014-09-15 18:17:22,035::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:23,038::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-47::DEBUG::2014-09-15 18:17:23,038::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:23,038::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-47::DEBUG::2014-09-15 18:17:23,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f2b022f-4761-41f1-8e48-674b05425590`::moving from state init -> state preparing >Thread-47::INFO::2014-09-15 18:17:23,039::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-47::DEBUG::2014-09-15 18:17:23,039::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-47::DEBUG::2014-09-15 18:17:23,040::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-47::INFO::2014-09-15 18:17:23,040::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-47::DEBUG::2014-09-15 18:17:23,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f2b022f-4761-41f1-8e48-674b05425590`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-47::DEBUG::2014-09-15 18:17:23,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f2b022f-4761-41f1-8e48-674b05425590`::moving from state preparing -> state finished >Thread-47::DEBUG::2014-09-15 18:17:23,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-47::DEBUG::2014-09-15 18:17:23,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-47::DEBUG::2014-09-15 18:17:23,040::task::993::Storage.TaskManager.Task::(_decref) Task=`0f2b022f-4761-41f1-8e48-674b05425590`::ref 0 aborting False >Thread-47::DEBUG::2014-09-15 18:17:23,040::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-47::DEBUG::2014-09-15 18:17:23,040::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:24,043::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-48::DEBUG::2014-09-15 18:17:24,043::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:24,043::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-48::DEBUG::2014-09-15 18:17:24,044::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9fb09e6-d49b-4856-ac08-ec93d81786c1`::moving from state init -> state preparing >Thread-48::INFO::2014-09-15 18:17:24,044::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-48::DEBUG::2014-09-15 18:17:24,044::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-48::DEBUG::2014-09-15 18:17:24,044::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-48::INFO::2014-09-15 18:17:24,044::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-48::DEBUG::2014-09-15 18:17:24,044::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9fb09e6-d49b-4856-ac08-ec93d81786c1`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-48::DEBUG::2014-09-15 18:17:24,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9fb09e6-d49b-4856-ac08-ec93d81786c1`::moving from state preparing -> state finished >Thread-48::DEBUG::2014-09-15 18:17:24,045::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-48::DEBUG::2014-09-15 18:17:24,045::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-48::DEBUG::2014-09-15 18:17:24,045::task::993::Storage.TaskManager.Task::(_decref) Task=`f9fb09e6-d49b-4856-ac08-ec93d81786c1`::ref 0 aborting False >Thread-48::DEBUG::2014-09-15 18:17:24,045::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-48::DEBUG::2014-09-15 18:17:24,045::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:24,175::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:24,176::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-49::DEBUG::2014-09-15 18:17:24,176::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:25,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:25,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-50::DEBUG::2014-09-15 18:17:25,049::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-50::DEBUG::2014-09-15 18:17:25,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ed9f2c6-8069-4429-a389-e19943750984`::moving from state init -> state preparing >Thread-50::INFO::2014-09-15 18:17:25,050::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-50::DEBUG::2014-09-15 18:17:25,050::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-50::DEBUG::2014-09-15 18:17:25,050::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-50::INFO::2014-09-15 18:17:25,050::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-50::DEBUG::2014-09-15 18:17:25,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ed9f2c6-8069-4429-a389-e19943750984`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-50::DEBUG::2014-09-15 18:17:25,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ed9f2c6-8069-4429-a389-e19943750984`::moving from state preparing -> state finished >Thread-50::DEBUG::2014-09-15 18:17:25,050::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-50::DEBUG::2014-09-15 18:17:25,050::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-50::DEBUG::2014-09-15 18:17:25,050::task::993::Storage.TaskManager.Task::(_decref) Task=`6ed9f2c6-8069-4429-a389-e19943750984`::ref 0 aborting False >Thread-50::DEBUG::2014-09-15 18:17:25,050::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-50::DEBUG::2014-09-15 18:17:25,050::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:26,053::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:26,054::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-51::DEBUG::2014-09-15 18:17:26,054::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-51::DEBUG::2014-09-15 18:17:26,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`115a8af0-96db-4cf8-a49f-10ac59a655b4`::moving from state init -> state preparing >Thread-51::INFO::2014-09-15 18:17:26,055::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-51::DEBUG::2014-09-15 18:17:26,055::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-51::DEBUG::2014-09-15 18:17:26,055::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-51::INFO::2014-09-15 18:17:26,055::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-51::DEBUG::2014-09-15 18:17:26,056::task::1191::Storage.TaskManager.Task::(prepare) Task=`115a8af0-96db-4cf8-a49f-10ac59a655b4`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-51::DEBUG::2014-09-15 18:17:26,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`115a8af0-96db-4cf8-a49f-10ac59a655b4`::moving from state preparing -> state finished >Thread-51::DEBUG::2014-09-15 18:17:26,056::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-51::DEBUG::2014-09-15 18:17:26,056::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-51::DEBUG::2014-09-15 18:17:26,056::task::993::Storage.TaskManager.Task::(_decref) Task=`115a8af0-96db-4cf8-a49f-10ac59a655b4`::ref 0 aborting False >Thread-51::DEBUG::2014-09-15 18:17:26,056::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-51::DEBUG::2014-09-15 18:17:26,056::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:27,059::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-52::DEBUG::2014-09-15 18:17:27,059::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:27,059::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-52::DEBUG::2014-09-15 18:17:27,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`f14316ec-9b7a-4a8a-9df4-24b6b28141b1`::moving from state init -> state preparing >Thread-52::INFO::2014-09-15 18:17:27,060::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-52::DEBUG::2014-09-15 18:17:27,060::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-52::DEBUG::2014-09-15 18:17:27,060::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-52::INFO::2014-09-15 18:17:27,060::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-52::DEBUG::2014-09-15 18:17:27,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`f14316ec-9b7a-4a8a-9df4-24b6b28141b1`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-52::DEBUG::2014-09-15 18:17:27,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`f14316ec-9b7a-4a8a-9df4-24b6b28141b1`::moving from state preparing -> state finished >Thread-52::DEBUG::2014-09-15 18:17:27,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-52::DEBUG::2014-09-15 18:17:27,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-52::DEBUG::2014-09-15 18:17:27,061::task::993::Storage.TaskManager.Task::(_decref) Task=`f14316ec-9b7a-4a8a-9df4-24b6b28141b1`::ref 0 aborting False >Thread-52::DEBUG::2014-09-15 18:17:27,061::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-52::DEBUG::2014-09-15 18:17:27,061::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:27,203::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:27,204::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-53::DEBUG::2014-09-15 18:17:27,204::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:28,063::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:28,063::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-54::DEBUG::2014-09-15 18:17:28,064::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-54::DEBUG::2014-09-15 18:17:28,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`565a2310-48b3-4799-a3ca-6a3ff7176afb`::moving from state init -> state preparing >Thread-54::INFO::2014-09-15 18:17:28,065::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-54::DEBUG::2014-09-15 18:17:28,065::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-54::DEBUG::2014-09-15 18:17:28,065::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-54::INFO::2014-09-15 18:17:28,065::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-54::DEBUG::2014-09-15 18:17:28,065::task::1191::Storage.TaskManager.Task::(prepare) Task=`565a2310-48b3-4799-a3ca-6a3ff7176afb`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-54::DEBUG::2014-09-15 18:17:28,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`565a2310-48b3-4799-a3ca-6a3ff7176afb`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-09-15 18:17:28,065::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-09-15 18:17:28,065::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-09-15 18:17:28,066::task::993::Storage.TaskManager.Task::(_decref) Task=`565a2310-48b3-4799-a3ca-6a3ff7176afb`::ref 0 aborting False >Thread-54::DEBUG::2014-09-15 18:17:28,066::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-54::DEBUG::2014-09-15 18:17:28,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:17:28,719::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:28,724::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000910555 s, 4.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:29,068::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-55::DEBUG::2014-09-15 18:17:29,069::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:29,069::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-55::DEBUG::2014-09-15 18:17:29,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ac28069-04af-459b-bc93-6f75dca0005e`::moving from state init -> state preparing >Thread-55::INFO::2014-09-15 18:17:29,070::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-55::DEBUG::2014-09-15 18:17:29,070::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-55::DEBUG::2014-09-15 18:17:29,070::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-55::INFO::2014-09-15 18:17:29,070::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-55::DEBUG::2014-09-15 18:17:29,070::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ac28069-04af-459b-bc93-6f75dca0005e`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-55::DEBUG::2014-09-15 18:17:29,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ac28069-04af-459b-bc93-6f75dca0005e`::moving from state preparing -> state finished >Thread-55::DEBUG::2014-09-15 18:17:29,071::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-55::DEBUG::2014-09-15 18:17:29,071::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55::DEBUG::2014-09-15 18:17:29,071::task::993::Storage.TaskManager.Task::(_decref) Task=`5ac28069-04af-459b-bc93-6f75dca0005e`::ref 0 aborting False >Thread-55::DEBUG::2014-09-15 18:17:29,071::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-55::DEBUG::2014-09-15 18:17:29,071::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,058::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 successfully acquired (id: 1) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,058::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/images >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::WARNING::2014-09-15 18:17:30,058::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/images already exists >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,058::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/dom_md >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::WARNING::2014-09-15 18:17:30,058::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/dom_md already exists >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,059::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,059::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,059::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,059::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,059::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,060::blockSD::336::Storage.Misc.excCmd::(readlines) /usr/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata count=1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,064::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000650298 s, 3.1 MB/s\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::misc::261::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000650298 s, 3.1 MB/s'], size: 2048 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,065::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:30,074::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:30,074::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-56::DEBUG::2014-09-15 18:17:30,075::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-56::DEBUG::2014-09-15 18:17:30,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`73603f7d-eb2a-4d13-8194-171fffccff91`::moving from state init -> state preparing >Thread-56::INFO::2014-09-15 18:17:30,076::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-56::DEBUG::2014-09-15 18:17:30,076::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-56::DEBUG::2014-09-15 18:17:30,076::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-56::INFO::2014-09-15 18:17:30,076::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-56::DEBUG::2014-09-15 18:17:30,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`73603f7d-eb2a-4d13-8194-171fffccff91`::finished: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-56::DEBUG::2014-09-15 18:17:30,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`73603f7d-eb2a-4d13-8194-171fffccff91`::moving from state preparing -> state finished >Thread-56::DEBUG::2014-09-15 18:17:30,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-56::DEBUG::2014-09-15 18:17:30,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-56::DEBUG::2014-09-15 18:17:30,076::task::993::Storage.TaskManager.Task::(_decref) Task=`73603f7d-eb2a-4d13-8194-171fffccff91`::ref 0 aborting False >Thread-56::DEBUG::2014-09-15 18:17:30,077::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-56::DEBUG::2014-09-15 18:17:30,077::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,135::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,136::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,136::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=-1', '_SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::INFO::2014-09-15 18:17:30,136::clusterlock::295::Storage.SANLock::(acquire) Acquiring cluster lock for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (id: 1) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,202::clusterlock::321::Storage.SANLock::(acquire) Cluster lock for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 successfully acquired (id: 1) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,202::sp::272::Storage.StoragePool::(startSpm) spm lock acquired successfully >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,202::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,202::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,202::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,203::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,203::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,203::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:30,215::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:30,216::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-57::DEBUG::2014-09-15 18:17:30,217::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,271::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,271::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,272::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'POOL_SPM_LVER=0', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=-1', '_SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,272::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,272::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,272::persistentDict::305::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=jumbo-57', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=iscsi-el7', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=1', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'ROLE=Master', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', '_SHA_CKSUM=8a5e3706afe5f739a1f782966162c893be7e9eaa'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,272::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,273::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,273::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,273::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,273::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,273::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,339::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,340::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,340::blockSD::315::Storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=8a5e3706afe5f739a1f782966162c893be7e9eaa, MDT_POOL_SPM_LVER=1, MDT_POOL_SPM_ID=1 removing=MDT_POOL_SPM_ID=-1, MDT__SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd, MDT_POOL_SPM_LVER=0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,340::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --deltag MDT_POOL_SPM_LVER=0 --deltag MDT_POOL_SPM_ID=-1 --deltag MDT__SHA_CKSUM=b16e061eda8d1dfae801c550a0521e22fc315ddd --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=8a5e3706afe5f739a1f782966162c893be7e9eaa --addtag MDT_POOL_SPM_LVER=1 b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,447::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,448::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,448::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,448::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,448::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`26f80eeb-4c7d-45f0-ad83-7d6dfad1efb1`::Request was made in '/usr/share/vdsm/storage/sp.py' line '426' at '_upgradePool' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,448::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,449::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,449::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`26f80eeb-4c7d-45f0-ad83-7d6dfad1efb1`::Granted request >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::INFO::2014-09-15 18:17:30,449::sp::432::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `b9c2b835-cdbd-48ea-8d69-7a33042c79b1` >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,449::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1`ReqID=`65e3da58-32c5-4265-b2fb-4a5315b5e139`::Request was made in '/usr/share/vdsm/storage/sp.py' line '434' at '_upgradePool' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,450::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1' for lock type 'exclusive' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,450::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1' is free. Now locking as 'exclusive' (1 active user) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,450::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1`ReqID=`65e3da58-32c5-4265-b2fb-4a5315b5e139`::Granted request >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::ERROR::2014-09-15 18:17:30,450::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::ERROR::2014-09-15 18:17:30,450::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,450::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,451::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,516::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,516::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,516::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,517::blockSD::336::Storage.Misc.excCmd::(readlines) /usr/bin/dd iflag=direct skip=0 bs=2048 if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata count=1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000540682 s, 3.8 MB/s\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::misc::261::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000540682 s, 3.8 MB/s'], size: 2048 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,521::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,522::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,522::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,522::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,522::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,588::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,588::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,589::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=8a5e3706afe5f739a1f782966162c893be7e9eaa', 'POOL_SPM_LVER=1'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::INFO::2014-09-15 18:17:30,589::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b9c2b835-cdbd-48ea-8d69-7a33042c79b1_imageNS already registered >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::INFO::2014-09-15 18:17:30,589::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b9c2b835-cdbd-48ea-8d69-7a33042c79b1_volumeNS already registered >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::INFO::2014-09-15 18:17:30,589::blockSD::448::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace b9c2b835-cdbd-48ea-8d69-7a33042c79b1_lvmActivationNS already registered >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,589::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1' (0 active users) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1' is free, finding out if anyone is waiting for it. >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b9c2b835-cdbd-48ea-8d69-7a33042c79b1', Clearing records. >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::sp::437::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,590::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,657::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,657::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,657::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=8a5e3706afe5f739a1f782966162c893be7e9eaa', 'POOL_SPM_LVER=1'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,658::sp::444::Storage.StoragePool::(_upgradePool) Registering with state change event >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,658::sp::447::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >Thread-58::DEBUG::2014-09-15 18:17:30,658::sp::152::Storage.StoragePool::(_upgradePoolDomain) Preparing to upgrade domain aa740243-00c8-498a-a94a-f8330738e5b9 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,658::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,659::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-58::DEBUG::2014-09-15 18:17:30,659::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9`ReqID=`057df5b2-761c-408a-9284-4406230477bf`::Request was made in '/usr/share/vdsm/storage/sp.py' line '163' at '_upgradePoolDomain' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,660::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-58::DEBUG::2014-09-15 18:17:30,660::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9' for lock type 'exclusive' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,660::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-58::DEBUG::2014-09-15 18:17:30,660::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9' is free. Now locking as 'exclusive' (1 active user) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,661::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master >Thread-58::DEBUG::2014-09-15 18:17:30,661::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9`ReqID=`057df5b2-761c-408a-9284-4406230477bf`::Granted request >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::WARNING::2014-09-15 18:17:30,661::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master already exists >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,662::blockSD::1126::Storage.Misc.excCmd::(mountMaster) /usr/bin/sudo -n /usr/sbin/fsck -p /dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master (cwd None) >Thread-58::DEBUG::2014-09-15 18:17:30,666::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.aa740243-00c8-498a-a94a-f8330738e5b9`ReqID=`e7cbbb32-6787-428a-9229-68ae6517ddba`::Request was made in '/usr/share/vdsm/storage/sp.py' line '165' at '_upgradePoolDomain' >Thread-58::DEBUG::2014-09-15 18:17:30,666::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.aa740243-00c8-498a-a94a-f8330738e5b9' for lock type 'exclusive' >Thread-58::DEBUG::2014-09-15 18:17:30,666::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.aa740243-00c8-498a-a94a-f8330738e5b9' is free. Now locking as 'exclusive' (1 active user) >Thread-58::DEBUG::2014-09-15 18:17:30,666::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.aa740243-00c8-498a-a94a-f8330738e5b9`ReqID=`e7cbbb32-6787-428a-9229-68ae6517ddba`::Granted request >Thread-58::DEBUG::2014-09-15 18:17:30,667::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-58::DEBUG::2014-09-15 18:17:30,667::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-58::DEBUG::2014-09-15 18:17:30,667::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-58::DEBUG::2014-09-15 18:17:30,667::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-58::DEBUG::2014-09-15 18:17:30,667::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-58::DEBUG::2014-09-15 18:17:30,667::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name aa740243-00c8-498a-a94a-f8330738e5b9 (cwd None) >Thread-58::DEBUG::2014-09-15 18:17:30,740::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-58::DEBUG::2014-09-15 18:17:30,740::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-58::DEBUG::2014-09-15 18:17:30,740::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'ROLE=Regular', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'VGUUID=Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'PHYBLKSIZE=512', 'SDUUID=aa740243-00c8-498a-a94a-f8330738e5b9', 'DESCRIPTION=jumbo-58', 'CLASS=Data', 'LOCKPOLICY=', u'PV0=pv:1IET_00060008,uuid:KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU,pestart:0,pecount:157,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', '_SHA_CKSUM=ac63e3c0c89a8ccd4884d41c6c47dbc0b98a3d97', 'MASTER_VERSION=0'] >Thread-58::DEBUG::2014-09-15 18:17:30,741::sp::192::Storage.StoragePool::(_upgradePoolDomain) All domains are upgraded, unregistering from state change event >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.aa740243-00c8-498a-a94a-f8330738e5b9' >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.aa740243-00c8-498a-a94a-f8330738e5b9' (0 active users) >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.aa740243-00c8-498a-a94a-f8330738e5b9' is free, finding out if anyone is waiting for it. >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.aa740243-00c8-498a-a94a-f8330738e5b9', Clearing records. >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9' >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9' (0 active users) >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9' is free, finding out if anyone is waiting for it. >Thread-58::DEBUG::2014-09-15 18:17:30,741::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_aa740243-00c8-498a-a94a-f8330738e5b9', Clearing records. >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,752::blockSD::1126::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,753::blockSD::1151::Storage.Misc.excCmd::(mountMaster) /usr/bin/sudo -n /usr/sbin/tune2fs -j /dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,764::blockSD::1151::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,764::mount::230::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /usr/bin/mount -t ext3 /dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,791::blockSD::1163::Storage.Misc.excCmd::(mountMaster) /usr/bin/sudo -n /usr/bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,801::blockSD::1163::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,802::sd::647::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master/vms >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,802::__init__::159::IOProcessClient::(_run) Starting IOProcess... >Thread-59::DEBUG::2014-09-15 18:17:30,806::__init__::232::IOProcess::(_processLogs) Closing unrelated FDs... >Thread-59::DEBUG::2014-09-15 18:17:30,806::__init__::232::IOProcess::(_processLogs) Opening communication channels... >Thread-59::DEBUG::2014-09-15 18:17:30,806::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,806::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,806::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,806::__init__::232::IOProcess::(_processLogs) (1) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) (1) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) (2) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) (2) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,807::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,808::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,808::__init__::232::IOProcess::(_processLogs) (3) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,808::__init__::232::IOProcess::(_processLogs) (3) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,808::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,808::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) (4) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) (4) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) (5) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,809::__init__::232::IOProcess::(_processLogs) (5) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,810::__init__::232::IOProcess::(_processLogs) (6) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,810::__init__::232::IOProcess::(_processLogs) (6) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) (7) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) (7) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,811::__init__::232::IOProcess::(_processLogs) (8) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,813::__init__::232::IOProcess::(_processLogs) (8) Queuing response >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,814::sd::650::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master/tasks >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) (9) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) (9) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,814::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) (10) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) (10) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) (11) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) (11) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,815::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) (12) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) (12) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) (13) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,816::__init__::232::IOProcess::(_processLogs) (13) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) (14) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) (14) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) (15) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,817::__init__::232::IOProcess::(_processLogs) (15) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:30,818::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:30,818::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:30,818::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:30,818::__init__::232::IOProcess::(_processLogs) (16) Got request for method 'mkdir' >Thread-59::DEBUG::2014-09-15 18:17:30,820::__init__::232::IOProcess::(_processLogs) (16) Queuing response >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,820::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,820::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,820::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,820::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,821::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,821::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,888::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,888::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,889::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', u'PV0=pv:1IET_00060007,uuid:NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2,pestart:0,pecount:157,mapoffset:0', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'PHYBLKSIZE=512', 'DESCRIPTION=jumbo-57', 'VGUUID=cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'SDUUID=b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=iscsi-el7', 'ROLE=Master', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', u'POOL_DOMAINS=b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'POOL_SPM_ID=1', '_SHA_CKSUM=8a5e3706afe5f739a1f782966162c893be7e9eaa', 'POOL_SPM_LVER=1'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,891::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,895::storage_mailbox::574::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,895::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,917::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168763 s, 60.7 MB/s\n'; <rc> = 0 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,917::storage_mailbox::582::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool b86b687a-d073-497a-ac8a-249025419a3e >Dummy-65::DEBUG::2014-09-15 18:17:30,918::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,918::sp::319::Storage.StoragePool::(startSpm) SPM mailbox ready for pool b86b687a-d073-497a-ac8a-249025419a3e on master domain b9c2b835-cdbd-48ea-8d69-7a33042c79b1 >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,923::sp::327::Storage.StoragePool::(startSpm) ended. >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::moving from state running -> state finished >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,925::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,925::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,926::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,926::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,927::task::916::Storage.TaskManager.Task::(_runJobs) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::Task.run: exit - success: result >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,927::task::993::Storage.TaskManager.Task::(_decref) Task=`9bd2e2cf-3e54-48f6-8ae5-2611478ac121`::ref 0 aborting False >9bd2e2cf-3e54-48f6-8ae5-2611478ac121::DEBUG::2014-09-15 18:17:30,927::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,080::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-66::DEBUG::2014-09-15 18:17:31,080::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.getStatus' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >JsonRpcServer::DEBUG::2014-09-15 18:17:31,080::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-66::DEBUG::2014-09-15 18:17:31,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea4c98c1-5bc8-449b-b114-d59c40ab6fc6`::moving from state init -> state preparing >Thread-66::INFO::2014-09-15 18:17:31,082::logUtils::48::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-66::DEBUG::2014-09-15 18:17:31,082::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-66::DEBUG::2014-09-15 18:17:31,082::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-66::INFO::2014-09-15 18:17:31,082::logUtils::51::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-66::DEBUG::2014-09-15 18:17:31,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea4c98c1-5bc8-449b-b114-d59c40ab6fc6`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'}} >Thread-66::DEBUG::2014-09-15 18:17:31,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea4c98c1-5bc8-449b-b114-d59c40ab6fc6`::moving from state preparing -> state finished >Thread-66::DEBUG::2014-09-15 18:17:31,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-66::DEBUG::2014-09-15 18:17:31,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-66::DEBUG::2014-09-15 18:17:31,082::task::993::Storage.TaskManager.Task::(_decref) Task=`ea4c98c1-5bc8-449b-b114-d59c40ab6fc6`::ref 0 aborting False >Thread-66::DEBUG::2014-09-15 18:17:31,082::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.getStatus' in bridge with {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-66::DEBUG::2014-09-15 18:17:31,083::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,086::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:31,087::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-67::DEBUG::2014-09-15 18:17:31,087::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-67::DEBUG::2014-09-15 18:17:31,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5bc2c8f-d33d-4fb6-9cb1-bff12ea8cbb4`::moving from state init -> state preparing >Thread-67::INFO::2014-09-15 18:17:31,088::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-67::INFO::2014-09-15 18:17:31,088::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-67::DEBUG::2014-09-15 18:17:31,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5bc2c8f-d33d-4fb6-9cb1-bff12ea8cbb4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-67::DEBUG::2014-09-15 18:17:31,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5bc2c8f-d33d-4fb6-9cb1-bff12ea8cbb4`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-09-15 18:17:31,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-09-15 18:17:31,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-09-15 18:17:31,088::task::993::Storage.TaskManager.Task::(_decref) Task=`d5bc2c8f-d33d-4fb6-9cb1-bff12ea8cbb4`::ref 0 aborting False >Thread-67::DEBUG::2014-09-15 18:17:31,088::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-67::DEBUG::2014-09-15 18:17:31,088::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,094::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:31,095::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-68::DEBUG::2014-09-15 18:17:31,095::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Task.clear' in bridge with {u'taskID': u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121'} >Thread-68::DEBUG::2014-09-15 18:17:31,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`874a99a7-e149-44cd-8876-4f7685f92cad`::moving from state init -> state preparing >Thread-68::INFO::2014-09-15 18:17:31,096::logUtils::48::dispatcher::(wrapper) Run and protect: clearTask(taskID=u'9bd2e2cf-3e54-48f6-8ae5-2611478ac121', spUUID=None, options=None) >Thread-68::DEBUG::2014-09-15 18:17:31,096::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 9bd2e2cf-3e54-48f6-8ae5-2611478ac121 >Thread-68::DEBUG::2014-09-15 18:17:31,096::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-68::INFO::2014-09-15 18:17:31,096::logUtils::51::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-68::DEBUG::2014-09-15 18:17:31,096::task::1191::Storage.TaskManager.Task::(prepare) Task=`874a99a7-e149-44cd-8876-4f7685f92cad`::finished: None >Thread-68::DEBUG::2014-09-15 18:17:31,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`874a99a7-e149-44cd-8876-4f7685f92cad`::moving from state preparing -> state finished >Thread-68::DEBUG::2014-09-15 18:17:31,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-68::DEBUG::2014-09-15 18:17:31,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2014-09-15 18:17:31,096::task::993::Storage.TaskManager.Task::(_decref) Task=`874a99a7-e149-44cd-8876-4f7685f92cad`::ref 0 aborting False >Thread-68::DEBUG::2014-09-15 18:17:31,096::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Task.clear' in bridge with True >Thread-68::DEBUG::2014-09-15 18:17:31,097::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:31,347::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.423592 s, 2.4 MB/s\n'; <rc> = 0 >Detector thread::DEBUG::2014-09-15 18:17:31,354::protocoldetector::179::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.0.141:56889 >Detector thread::DEBUG::2014-09-15 18:17:31,355::protocoldetector::190::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.0.141:56889 >Detector thread::DEBUG::2014-09-15 18:17:31,355::protocoldetector::216::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol stomp from 10.35.0.141:56889 >Detector thread::DEBUG::2014-09-15 18:17:31,355::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='CONNECT'> >Detector thread::INFO::2014-09-15 18:17:31,355::stompReactor::66::Broker.StompAdapter::(_cmd_connect) Processing CONNECT request >Detector thread::DEBUG::2014-09-15 18:17:31,356::stompReactor::338::protocoldetector.StompDetector::(handleSocket) Stomp detected from ('10.35.0.141', 56889) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,356::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SUBSCRIBE'> >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,356::stompReactor::89::Broker.StompAdapter::(_cmd_subscribe) Subscribe command ignored >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,397::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:31,397::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-69::DEBUG::2014-09-15 18:17:31,398::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-69::DEBUG::2014-09-15 18:17:31,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`70e1ccc4-2ff9-4889-910e-c704d6b4d775`::moving from state init -> state preparing >Thread-69::INFO::2014-09-15 18:17:31,398::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-69::DEBUG::2014-09-15 18:17:31,399::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`7e9b5289-cd8a-4b0a-9112-16fa7ade4a98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-69::DEBUG::2014-09-15 18:17:31,399::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-69::DEBUG::2014-09-15 18:17:31,399::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-69::DEBUG::2014-09-15 18:17:31,399::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`7e9b5289-cd8a-4b0a-9112-16fa7ade4a98`::Granted request >Thread-69::DEBUG::2014-09-15 18:17:31,399::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`70e1ccc4-2ff9-4889-910e-c704d6b4d775`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-69::DEBUG::2014-09-15 18:17:31,399::task::993::Storage.TaskManager.Task::(_decref) Task=`70e1ccc4-2ff9-4889-910e-c704d6b4d775`::ref 1 aborting False >Thread-69::INFO::2014-09-15 18:17:31,400::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-69::DEBUG::2014-09-15 18:17:31,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`70e1ccc4-2ff9-4889-910e-c704d6b4d775`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-69::DEBUG::2014-09-15 18:17:31,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`70e1ccc4-2ff9-4889-910e-c704d6b4d775`::moving from state preparing -> state finished >Thread-69::DEBUG::2014-09-15 18:17:31,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-69::DEBUG::2014-09-15 18:17:31,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2014-09-15 18:17:31,400::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-69::DEBUG::2014-09-15 18:17:31,400::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-69::DEBUG::2014-09-15 18:17:31,400::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-69::DEBUG::2014-09-15 18:17:31,400::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-69::DEBUG::2014-09-15 18:17:31,400::task::993::Storage.TaskManager.Task::(_decref) Task=`70e1ccc4-2ff9-4889-910e-c704d6b4d775`::ref 0 aborting False >Thread-69::DEBUG::2014-09-15 18:17:31,401::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-69::DEBUG::2014-09-15 18:17:31,401::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,429::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:31,430::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-70::DEBUG::2014-09-15 18:17:31,430::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'LVMVolumeGroup.getInfo' in bridge with {u'lvmvolumegroupID': u'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc'} >Thread-70::DEBUG::2014-09-15 18:17:31,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f6451b6-6598-47df-8ac1-fce66d49f723`::moving from state init -> state preparing >Thread-70::INFO::2014-09-15 18:17:31,431::logUtils::48::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID=u'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', options=None) >Thread-70::DEBUG::2014-09-15 18:17:31,431::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-70::DEBUG::2014-09-15 18:17:31,431::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,469::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:31,470::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:31,470::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-71::DEBUG::2014-09-15 18:17:31,470::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'LVMVolumeGroup.getInfo' in bridge with {u'lvmvolumegroupID': u'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj'} >JsonRpcServer::DEBUG::2014-09-15 18:17:31,472::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-72::DEBUG::2014-09-15 18:17:31,472::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getAllTasksInfo' in bridge with {} >Thread-72::DEBUG::2014-09-15 18:17:31,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f38d253-101c-4a4a-9dc9-6a3855bf3710`::moving from state init -> state preparing >Thread-71::DEBUG::2014-09-15 18:17:31,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`77b9cebe-84a4-4625-970b-9361d5badf68`::moving from state init -> state preparing >Thread-72::INFO::2014-09-15 18:17:31,475::logUtils::48::dispatcher::(wrapper) Run and protect: getAllTasksInfo(spUUID=None, options=None) >Thread-71::INFO::2014-09-15 18:17:31,476::logUtils::48::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID=u'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', options=None) >Thread-72::DEBUG::2014-09-15 18:17:31,476::taskManager::191::Storage.TaskManager::(getAllTasksInfo) Entry. >Thread-72::DEBUG::2014-09-15 18:17:31,476::taskManager::202::Storage.TaskManager::(getAllTasksInfo) Return. Response: {} >Thread-72::INFO::2014-09-15 18:17:31,477::logUtils::51::dispatcher::(wrapper) Run and protect: getAllTasksInfo, Return response: {'allTasksInfo': {}} >Thread-71::DEBUG::2014-09-15 18:17:31,476::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex >Thread-72::DEBUG::2014-09-15 18:17:31,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f38d253-101c-4a4a-9dc9-6a3855bf3710`::finished: {'allTasksInfo': {}} >Thread-72::DEBUG::2014-09-15 18:17:31,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f38d253-101c-4a4a-9dc9-6a3855bf3710`::moving from state preparing -> state finished >Thread-71::DEBUG::2014-09-15 18:17:31,477::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-72::DEBUG::2014-09-15 18:17:31,478::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-72::DEBUG::2014-09-15 18:17:31,478::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-72::DEBUG::2014-09-15 18:17:31,482::task::993::Storage.TaskManager.Task::(_decref) Task=`0f38d253-101c-4a4a-9dc9-6a3855bf3710`::ref 0 aborting False >Thread-72::DEBUG::2014-09-15 18:17:31,483::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getAllTasksInfo' in bridge with {} >Thread-72::DEBUG::2014-09-15 18:17:31,483::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-70::DEBUG::2014-09-15 18:17:31,576::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-70::DEBUG::2014-09-15 18:17:31,588::lvm::317::Storage.OperationMutex::(_reloadpvs) Got the operational mutex >Thread-70::DEBUG::2014-09-15 18:17:31,589::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1IET_00060007 (cwd None) >Thread-71::DEBUG::2014-09-15 18:17:31,632::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-71::DEBUG::2014-09-15 18:17:31,645::lvm::317::Storage.OperationMutex::(_reloadpvs) Got the operational mutex >Thread-71::DEBUG::2014-09-15 18:17:31,645::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/1IET_00060008 (cwd None) >Thread-70::DEBUG::2014-09-15 18:17:31,699::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-70::INFO::2014-09-15 18:17:31,699::logUtils::51::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '21072183296', 'name': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'vgfree': '16911433728', 'vgUUID': 'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'pvlist': [{'vendorID': 'Red Cat', 'capacity': '21072183296', 'fwrev': '0000', 'vgUUID': 'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'pathlist': [{'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdl', 'type': 'iSCSI', 'state': 'active', 'lun': '7'}], 'devtype': 'iSCSI', 'pvUUID': 'NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2', 'serial': 'SRed_Cat_VIRTUAL-DISK', 'GUID': '1IET_00060007', 'devcapacity': '21474836480', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-70::DEBUG::2014-09-15 18:17:31,699::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f6451b6-6598-47df-8ac1-fce66d49f723`::finished: {'info': {'state': 'OK', 'vgsize': '21072183296', 'name': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'vgfree': '16911433728', 'vgUUID': 'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'pvlist': [{'vendorID': 'Red Cat', 'capacity': '21072183296', 'fwrev': '0000', 'vgUUID': 'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'pathlist': [{'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdl', 'type': 'iSCSI', 'state': 'active', 'lun': '7'}], 'devtype': 'iSCSI', 'pvUUID': 'NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2', 'serial': 'SRed_Cat_VIRTUAL-DISK', 'GUID': '1IET_00060007', 'devcapacity': '21474836480', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-70::DEBUG::2014-09-15 18:17:31,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f6451b6-6598-47df-8ac1-fce66d49f723`::moving from state preparing -> state finished >Thread-70::DEBUG::2014-09-15 18:17:31,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-70::DEBUG::2014-09-15 18:17:31,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-70::DEBUG::2014-09-15 18:17:31,699::task::993::Storage.TaskManager.Task::(_decref) Task=`9f6451b6-6598-47df-8ac1-fce66d49f723`::ref 0 aborting False >Thread-70::WARNING::2014-09-15 18:17:31,700::Bridge::210::root::(_typeFixup) Fixing up type VolumeGroupInfo >Thread-70::WARNING::2014-09-15 18:17:31,700::Bridge::449::root::(fieldClone) fieldClone: type -> deviceType >Thread-70::DEBUG::2014-09-15 18:17:31,700::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'LVMVolumeGroup.getInfo' in bridge with {'state': 'OK', 'deviceType': 3, 'vgsize': '21072183296', 'name': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'vgfree': '16911433728', 'vgUUID': 'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'pvlist': [{'vendorID': 'Red Cat', 'capacity': '21072183296', 'fwrev': '0000', 'vgUUID': 'cj2eX2-T2M2-sIbC-YyEJ-Bmun-Myi5-XCyhzc', 'pathlist': [{'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdl', 'type': 'iSCSI', 'state': 'active', 'lun': '7'}], 'devtype': 'iSCSI', 'pvUUID': 'NID0Te-VHrS-5ghV-wLcv-n8lb-aflw-sutlh2', 'serial': 'SRed_Cat_VIRTUAL-DISK', 'GUID': '1IET_00060007', 'devcapacity': '21474836480', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}} >Thread-70::DEBUG::2014-09-15 18:17:31,700::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-71::DEBUG::2014-09-15 18:17:31,742::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-71::DEBUG::2014-09-15 18:17:31,742::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-71::INFO::2014-09-15 18:17:31,743::logUtils::51::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '21072183296', 'name': 'aa740243-00c8-498a-a94a-f8330738e5b9', 'vgfree': '16911433728', 'vgUUID': 'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'pvlist': [{'vendorID': 'Red Cat', 'capacity': '21072183296', 'fwrev': '0000', 'vgUUID': 'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'pathlist': [{'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdm', 'type': 'iSCSI', 'state': 'active', 'lun': '8'}], 'devtype': 'iSCSI', 'pvUUID': 'KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU', 'serial': 'SRed_Cat_VIRTUAL-DISK', 'GUID': '1IET_00060008', 'devcapacity': '21474836480', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-71::DEBUG::2014-09-15 18:17:31,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`77b9cebe-84a4-4625-970b-9361d5badf68`::finished: {'info': {'state': 'OK', 'vgsize': '21072183296', 'name': 'aa740243-00c8-498a-a94a-f8330738e5b9', 'vgfree': '16911433728', 'vgUUID': 'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'pvlist': [{'vendorID': 'Red Cat', 'capacity': '21072183296', 'fwrev': '0000', 'vgUUID': 'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'pathlist': [{'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdm', 'type': 'iSCSI', 'state': 'active', 'lun': '8'}], 'devtype': 'iSCSI', 'pvUUID': 'KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU', 'serial': 'SRed_Cat_VIRTUAL-DISK', 'GUID': '1IET_00060008', 'devcapacity': '21474836480', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-71::DEBUG::2014-09-15 18:17:31,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`77b9cebe-84a4-4625-970b-9361d5badf68`::moving from state preparing -> state finished >Thread-71::DEBUG::2014-09-15 18:17:31,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-71::DEBUG::2014-09-15 18:17:31,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-71::DEBUG::2014-09-15 18:17:31,743::task::993::Storage.TaskManager.Task::(_decref) Task=`77b9cebe-84a4-4625-970b-9361d5badf68`::ref 0 aborting False >Thread-71::WARNING::2014-09-15 18:17:31,743::Bridge::210::root::(_typeFixup) Fixing up type VolumeGroupInfo >Thread-71::WARNING::2014-09-15 18:17:31,743::Bridge::449::root::(fieldClone) fieldClone: type -> deviceType >Thread-71::DEBUG::2014-09-15 18:17:31,743::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'LVMVolumeGroup.getInfo' in bridge with {'state': 'OK', 'deviceType': 3, 'vgsize': '21072183296', 'name': 'aa740243-00c8-498a-a94a-f8330738e5b9', 'vgfree': '16911433728', 'vgUUID': 'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'pvlist': [{'vendorID': 'Red Cat', 'capacity': '21072183296', 'fwrev': '0000', 'vgUUID': 'Nbt1MO-vWgw-To2s-ytNe-AMWh-4fj9-uCrirj', 'pathlist': [{'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdm', 'type': 'iSCSI', 'state': 'active', 'lun': '8'}], 'devtype': 'iSCSI', 'pvUUID': 'KUcNT0-jKCl-jj2Y-AQBB-dPya-I71u-T5gtBU', 'serial': 'SRed_Cat_VIRTUAL-DISK', 'GUID': '1IET_00060008', 'devcapacity': '21474836480', 'productID': 'VIRTUAL-DISK'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}} >Thread-71::DEBUG::2014-09-15 18:17:31,744::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:33,226::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:33,227::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-73::DEBUG::2014-09-15 18:17:33,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0974517-75e2-4ea8-8a57-34bba49f2568`::moving from state init -> state preparing >Thread-73::INFO::2014-09-15 18:17:33,228::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-73::INFO::2014-09-15 18:17:33,229::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000843116', 'lastCheck': '3.2', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000910555', 'lastCheck': '4.5', 'valid': True}} >Thread-73::DEBUG::2014-09-15 18:17:33,229::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0974517-75e2-4ea8-8a57-34bba49f2568`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000843116', 'lastCheck': '3.2', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000910555', 'lastCheck': '4.5', 'valid': True}} >Thread-73::DEBUG::2014-09-15 18:17:33,229::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0974517-75e2-4ea8-8a57-34bba49f2568`::moving from state preparing -> state finished >Thread-73::DEBUG::2014-09-15 18:17:33,229::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-73::DEBUG::2014-09-15 18:17:33,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-73::DEBUG::2014-09-15 18:17:33,229::task::993::Storage.TaskManager.Task::(_decref) Task=`f0974517-75e2-4ea8-8a57-34bba49f2568`::ref 0 aborting False >Thread-73::DEBUG::2014-09-15 18:17:33,230::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:33,242::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:33,243::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-74::DEBUG::2014-09-15 18:17:33,244::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:33,355::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:33,375::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146484 s, 69.9 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:17:35,383::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:35,403::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156022 s, 65.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:36,345::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:36,345::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-75::DEBUG::2014-09-15 18:17:36,346::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:37,411::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:37,431::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156915 s, 65.3 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:38,726::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:38,731::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000986153 s, 4.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:39,391::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:39,392::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-76::DEBUG::2014-09-15 18:17:39,393::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:39,439::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:39,459::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0151732 s, 67.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:17:40,060::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /usr/sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|'\'', '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' b9c2b835-cdbd-48ea-8d69-7a33042c79b1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:17:40,087::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: lvmetad is running but disabled. Restart lvmetad before enabling it!\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:17:40,087::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:17:40,092::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000572514 s, 7.2 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:17:40,093::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:40,094::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:40,094::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:40,094::__init__::232::IOProcess::(_processLogs) (17) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:17:40,094::__init__::232::IOProcess::(_processLogs) (17) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:40,094::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:40,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:40,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:40,095::__init__::232::IOProcess::(_processLogs) (18) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:17:40,095::__init__::232::IOProcess::(_processLogs) (18) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:41,446::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-77::DEBUG::2014-09-15 18:17:41,446::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:17:41,446::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-77::DEBUG::2014-09-15 18:17:41,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ede1317-ad1f-4020-8c83-786210b7ad99`::moving from state init -> state preparing >Thread-77::INFO::2014-09-15 18:17:41,448::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-77::INFO::2014-09-15 18:17:41,448::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-77::DEBUG::2014-09-15 18:17:41,448::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ede1317-ad1f-4020-8c83-786210b7ad99`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-77::DEBUG::2014-09-15 18:17:41,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ede1317-ad1f-4020-8c83-786210b7ad99`::moving from state preparing -> state finished >Thread-77::DEBUG::2014-09-15 18:17:41,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-77::DEBUG::2014-09-15 18:17:41,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-77::DEBUG::2014-09-15 18:17:41,448::task::993::Storage.TaskManager.Task::(_decref) Task=`5ede1317-ad1f-4020-8c83-786210b7ad99`::ref 0 aborting False >Thread-77::DEBUG::2014-09-15 18:17:41,448::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-77::DEBUG::2014-09-15 18:17:41,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:41,452::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:41,453::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-78::DEBUG::2014-09-15 18:17:41,453::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-78::DEBUG::2014-09-15 18:17:41,453::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2b24775-6551-4eb5-ac64-95e033bcd8de`::moving from state init -> state preparing >Thread-78::INFO::2014-09-15 18:17:41,454::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-78::DEBUG::2014-09-15 18:17:41,454::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`9bc9f860-b818-4fe1-91be-e8552727c467`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-78::DEBUG::2014-09-15 18:17:41,454::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-78::DEBUG::2014-09-15 18:17:41,454::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-78::DEBUG::2014-09-15 18:17:41,454::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`9bc9f860-b818-4fe1-91be-e8552727c467`::Granted request >Thread-78::DEBUG::2014-09-15 18:17:41,454::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e2b24775-6551-4eb5-ac64-95e033bcd8de`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-78::DEBUG::2014-09-15 18:17:41,454::task::993::Storage.TaskManager.Task::(_decref) Task=`e2b24775-6551-4eb5-ac64-95e033bcd8de`::ref 1 aborting False >Thread-78::INFO::2014-09-15 18:17:41,455::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-78::DEBUG::2014-09-15 18:17:41,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2b24775-6551-4eb5-ac64-95e033bcd8de`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-78::DEBUG::2014-09-15 18:17:41,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2b24775-6551-4eb5-ac64-95e033bcd8de`::moving from state preparing -> state finished >Thread-78::DEBUG::2014-09-15 18:17:41,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-78::DEBUG::2014-09-15 18:17:41,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2014-09-15 18:17:41,455::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-78::DEBUG::2014-09-15 18:17:41,455::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-78::DEBUG::2014-09-15 18:17:41,455::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-78::DEBUG::2014-09-15 18:17:41,455::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-78::DEBUG::2014-09-15 18:17:41,456::task::993::Storage.TaskManager.Task::(_decref) Task=`e2b24775-6551-4eb5-ac64-95e033bcd8de`::ref 0 aborting False >Thread-78::DEBUG::2014-09-15 18:17:41,456::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-78::DEBUG::2014-09-15 18:17:41,456::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:41,467::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:41,490::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0187319 s, 54.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:42,418::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:42,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-79::DEBUG::2014-09-15 18:17:42,420::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:43,498::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:43,516::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119549 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:45,448::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:45,449::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-80::DEBUG::2014-09-15 18:17:45,449::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:45,524::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:45,540::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122345 s, 83.7 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:17:47,548::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:47,569::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163495 s, 62.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:48,480::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:48,481::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-81::DEBUG::2014-09-15 18:17:48,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dec48c1-54f0-438b-8f41-1fd19c9f5b9a`::moving from state init -> state preparing >Thread-81::INFO::2014-09-15 18:17:48,482::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2014-09-15 18:17:48,482::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572514', 'lastCheck': '8.4', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000986153', 'lastCheck': '9.8', 'valid': True}} >Thread-81::DEBUG::2014-09-15 18:17:48,482::task::1191::Storage.TaskManager.Task::(prepare) Task=`2dec48c1-54f0-438b-8f41-1fd19c9f5b9a`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000572514', 'lastCheck': '8.4', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000986153', 'lastCheck': '9.8', 'valid': True}} >Thread-81::DEBUG::2014-09-15 18:17:48,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`2dec48c1-54f0-438b-8f41-1fd19c9f5b9a`::moving from state preparing -> state finished >Thread-81::DEBUG::2014-09-15 18:17:48,483::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2014-09-15 18:17:48,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2014-09-15 18:17:48,483::task::993::Storage.TaskManager.Task::(_decref) Task=`2dec48c1-54f0-438b-8f41-1fd19c9f5b9a`::ref 0 aborting False >Thread-81::DEBUG::2014-09-15 18:17:48,484::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:48,502::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:48,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-82::DEBUG::2014-09-15 18:17:48,503::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:17:48,732::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:48,738::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000882775 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:17:49,577::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:49,602::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200106 s, 51.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:17:50,096::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:17:50,101::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000767434 s, 5.3 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:17:50,102::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) (19) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) (19) Queuing response >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:17:50,103::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:17:50,104::__init__::232::IOProcess::(_processLogs) (20) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:17:50,104::__init__::232::IOProcess::(_processLogs) (20) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:51,512::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-83::DEBUG::2014-09-15 18:17:51,513::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:17:51,513::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-83::DEBUG::2014-09-15 18:17:51,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa71f9d6-5308-413a-a227-ff71bd5e0643`::moving from state init -> state preparing >Thread-83::INFO::2014-09-15 18:17:51,514::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-83::INFO::2014-09-15 18:17:51,514::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-83::DEBUG::2014-09-15 18:17:51,514::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa71f9d6-5308-413a-a227-ff71bd5e0643`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-83::DEBUG::2014-09-15 18:17:51,514::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa71f9d6-5308-413a-a227-ff71bd5e0643`::moving from state preparing -> state finished >Thread-83::DEBUG::2014-09-15 18:17:51,514::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-83::DEBUG::2014-09-15 18:17:51,515::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-83::DEBUG::2014-09-15 18:17:51,515::task::993::Storage.TaskManager.Task::(_decref) Task=`aa71f9d6-5308-413a-a227-ff71bd5e0643`::ref 0 aborting False >Thread-83::DEBUG::2014-09-15 18:17:51,515::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-83::DEBUG::2014-09-15 18:17:51,515::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:51,523::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:51,523::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-84::DEBUG::2014-09-15 18:17:51,523::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-84::DEBUG::2014-09-15 18:17:51,524::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ba41613-011e-4582-aea9-06c5fd3db7e9`::moving from state init -> state preparing >Thread-84::INFO::2014-09-15 18:17:51,524::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-84::DEBUG::2014-09-15 18:17:51,525::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`15090d04-2501-4c44-8b03-2397e76e1fe8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-84::DEBUG::2014-09-15 18:17:51,525::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-84::DEBUG::2014-09-15 18:17:51,525::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-84::DEBUG::2014-09-15 18:17:51,525::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`15090d04-2501-4c44-8b03-2397e76e1fe8`::Granted request >Thread-84::DEBUG::2014-09-15 18:17:51,525::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9ba41613-011e-4582-aea9-06c5fd3db7e9`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-84::DEBUG::2014-09-15 18:17:51,525::task::993::Storage.TaskManager.Task::(_decref) Task=`9ba41613-011e-4582-aea9-06c5fd3db7e9`::ref 1 aborting False >Thread-84::INFO::2014-09-15 18:17:51,526::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-84::DEBUG::2014-09-15 18:17:51,526::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ba41613-011e-4582-aea9-06c5fd3db7e9`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-84::DEBUG::2014-09-15 18:17:51,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ba41613-011e-4582-aea9-06c5fd3db7e9`::moving from state preparing -> state finished >Thread-84::DEBUG::2014-09-15 18:17:51,526::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-84::DEBUG::2014-09-15 18:17:51,526::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-84::DEBUG::2014-09-15 18:17:51,526::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-84::DEBUG::2014-09-15 18:17:51,526::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-84::DEBUG::2014-09-15 18:17:51,526::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-84::DEBUG::2014-09-15 18:17:51,526::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-84::DEBUG::2014-09-15 18:17:51,526::task::993::Storage.TaskManager.Task::(_decref) Task=`9ba41613-011e-4582-aea9-06c5fd3db7e9`::ref 0 aborting False >Thread-84::DEBUG::2014-09-15 18:17:51,526::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-84::DEBUG::2014-09-15 18:17:51,527::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:51,640::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:51,640::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-85::DEBUG::2014-09-15 18:17:51,641::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:51,694::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:51,713::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141773 s, 72.2 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:17:53,720::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:53,743::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180689 s, 56.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:54,676::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:54,677::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-86::DEBUG::2014-09-15 18:17:54,678::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:55,751::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:55,770::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127768 s, 80.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:17:57,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:17:57,701::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-87::DEBUG::2014-09-15 18:17:57,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:17:57,778::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:57,798::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155388 s, 65.9 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:17:58,739::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:17:58,744::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00095468 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:17:59,806::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:17:59,822::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116333 s, 88.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:18:00,104::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:18:00,109::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781368 s, 5.2 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:18:00,110::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:00,110::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) (21) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) (21) Queuing response >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) (22) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:00,111::__init__::232::IOProcess::(_processLogs) (22) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:00,722::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:00,723::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-88::DEBUG::2014-09-15 18:18:00,724::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:01,566::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-89::DEBUG::2014-09-15 18:18:01,567::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:01,567::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-89::DEBUG::2014-09-15 18:18:01,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`54966a6a-31a5-4231-bfc6-86c0b637fa0c`::moving from state init -> state preparing >Thread-89::INFO::2014-09-15 18:18:01,568::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-89::INFO::2014-09-15 18:18:01,568::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-89::DEBUG::2014-09-15 18:18:01,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`54966a6a-31a5-4231-bfc6-86c0b637fa0c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-89::DEBUG::2014-09-15 18:18:01,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`54966a6a-31a5-4231-bfc6-86c0b637fa0c`::moving from state preparing -> state finished >Thread-89::DEBUG::2014-09-15 18:18:01,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-89::DEBUG::2014-09-15 18:18:01,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-89::DEBUG::2014-09-15 18:18:01,568::task::993::Storage.TaskManager.Task::(_decref) Task=`54966a6a-31a5-4231-bfc6-86c0b637fa0c`::ref 0 aborting False >Thread-89::DEBUG::2014-09-15 18:18:01,569::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-89::DEBUG::2014-09-15 18:18:01,569::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:01,573::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-90::DEBUG::2014-09-15 18:18:01,573::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:01,573::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-90::DEBUG::2014-09-15 18:18:01,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dfc6f95-c2ce-41a4-ac55-1da2e71923d2`::moving from state init -> state preparing >Thread-90::INFO::2014-09-15 18:18:01,574::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-90::DEBUG::2014-09-15 18:18:01,574::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ac351d6e-1de4-471e-88e2-4ae60865397d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-90::DEBUG::2014-09-15 18:18:01,574::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-90::DEBUG::2014-09-15 18:18:01,575::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-90::DEBUG::2014-09-15 18:18:01,575::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ac351d6e-1de4-471e-88e2-4ae60865397d`::Granted request >Thread-90::DEBUG::2014-09-15 18:18:01,575::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7dfc6f95-c2ce-41a4-ac55-1da2e71923d2`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-90::DEBUG::2014-09-15 18:18:01,575::task::993::Storage.TaskManager.Task::(_decref) Task=`7dfc6f95-c2ce-41a4-ac55-1da2e71923d2`::ref 1 aborting False >Thread-90::INFO::2014-09-15 18:18:01,575::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-90::DEBUG::2014-09-15 18:18:01,575::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dfc6f95-c2ce-41a4-ac55-1da2e71923d2`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-90::DEBUG::2014-09-15 18:18:01,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dfc6f95-c2ce-41a4-ac55-1da2e71923d2`::moving from state preparing -> state finished >Thread-90::DEBUG::2014-09-15 18:18:01,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-90::DEBUG::2014-09-15 18:18:01,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-90::DEBUG::2014-09-15 18:18:01,576::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-90::DEBUG::2014-09-15 18:18:01,576::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-90::DEBUG::2014-09-15 18:18:01,576::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-90::DEBUG::2014-09-15 18:18:01,576::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-90::DEBUG::2014-09-15 18:18:01,576::task::993::Storage.TaskManager.Task::(_decref) Task=`7dfc6f95-c2ce-41a4-ac55-1da2e71923d2`::ref 0 aborting False >Thread-90::DEBUG::2014-09-15 18:18:01,576::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-90::DEBUG::2014-09-15 18:18:01,576::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:01,830::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:01,853::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184274 s, 55.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:03,765::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:03,766::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-91::DEBUG::2014-09-15 18:18:03,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d7dd436-f165-458f-abee-42fdc8e465e1`::moving from state init -> state preparing >Thread-91::INFO::2014-09-15 18:18:03,767::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-91::INFO::2014-09-15 18:18:03,767::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781368', 'lastCheck': '3.7', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095468', 'lastCheck': '5.0', 'valid': True}} >Thread-91::DEBUG::2014-09-15 18:18:03,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d7dd436-f165-458f-abee-42fdc8e465e1`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781368', 'lastCheck': '3.7', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00095468', 'lastCheck': '5.0', 'valid': True}} >Thread-91::DEBUG::2014-09-15 18:18:03,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d7dd436-f165-458f-abee-42fdc8e465e1`::moving from state preparing -> state finished >Thread-91::DEBUG::2014-09-15 18:18:03,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-91::DEBUG::2014-09-15 18:18:03,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2014-09-15 18:18:03,767::task::993::Storage.TaskManager.Task::(_decref) Task=`5d7dd436-f165-458f-abee-42fdc8e465e1`::ref 0 aborting False >Thread-91::DEBUG::2014-09-15 18:18:03,768::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:03,784::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:03,784::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-92::DEBUG::2014-09-15 18:18:03,785::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:03,860::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:03,877::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120531 s, 85.0 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:05,885::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:05,905::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0140168 s, 73.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:06,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:06,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-93::DEBUG::2014-09-15 18:18:06,899::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:07,913::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:07,933::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156007 s, 65.6 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:18:08,745::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:18:08,750::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00091274 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:09,941::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:09,950::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:09,951::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-94::DEBUG::2014-09-15 18:18:09,952::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:09,957::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119261 s, 85.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:18:10,112::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:18:10,117::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0010501 s, 3.9 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:18:10,119::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:10,119::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:10,119::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:10,119::__init__::232::IOProcess::(_processLogs) (23) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:10,119::__init__::232::IOProcess::(_processLogs) (23) Queuing response >Thread-59::DEBUG::2014-09-15 18:18:10,120::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:10,120::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:10,120::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:10,120::__init__::232::IOProcess::(_processLogs) (24) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:10,121::__init__::232::IOProcess::(_processLogs) (24) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:11,623::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-95::DEBUG::2014-09-15 18:18:11,624::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:11,624::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-95::DEBUG::2014-09-15 18:18:11,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`749ea2fa-ffde-48d5-98ad-9c21d9fbb98b`::moving from state init -> state preparing >Thread-95::INFO::2014-09-15 18:18:11,625::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-95::INFO::2014-09-15 18:18:11,626::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-95::DEBUG::2014-09-15 18:18:11,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`749ea2fa-ffde-48d5-98ad-9c21d9fbb98b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-95::DEBUG::2014-09-15 18:18:11,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`749ea2fa-ffde-48d5-98ad-9c21d9fbb98b`::moving from state preparing -> state finished >Thread-95::DEBUG::2014-09-15 18:18:11,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-95::DEBUG::2014-09-15 18:18:11,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-95::DEBUG::2014-09-15 18:18:11,626::task::993::Storage.TaskManager.Task::(_decref) Task=`749ea2fa-ffde-48d5-98ad-9c21d9fbb98b`::ref 0 aborting False >Thread-95::DEBUG::2014-09-15 18:18:11,626::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-95::DEBUG::2014-09-15 18:18:11,626::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:11,633::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:11,634::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-96::DEBUG::2014-09-15 18:18:11,634::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-96::DEBUG::2014-09-15 18:18:11,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5d515fb-3434-414e-842a-6e5d8a1f651b`::moving from state init -> state preparing >Thread-96::INFO::2014-09-15 18:18:11,634::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-96::DEBUG::2014-09-15 18:18:11,635::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`da9cd492-3caf-4723-82ef-e475b170fdf6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-96::DEBUG::2014-09-15 18:18:11,635::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-96::DEBUG::2014-09-15 18:18:11,635::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-96::DEBUG::2014-09-15 18:18:11,635::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`da9cd492-3caf-4723-82ef-e475b170fdf6`::Granted request >Thread-96::DEBUG::2014-09-15 18:18:11,636::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c5d515fb-3434-414e-842a-6e5d8a1f651b`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-96::DEBUG::2014-09-15 18:18:11,636::task::993::Storage.TaskManager.Task::(_decref) Task=`c5d515fb-3434-414e-842a-6e5d8a1f651b`::ref 1 aborting False >Thread-96::INFO::2014-09-15 18:18:11,636::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-96::DEBUG::2014-09-15 18:18:11,636::task::1191::Storage.TaskManager.Task::(prepare) Task=`c5d515fb-3434-414e-842a-6e5d8a1f651b`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-96::DEBUG::2014-09-15 18:18:11,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`c5d515fb-3434-414e-842a-6e5d8a1f651b`::moving from state preparing -> state finished >Thread-96::DEBUG::2014-09-15 18:18:11,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-96::DEBUG::2014-09-15 18:18:11,637::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-96::DEBUG::2014-09-15 18:18:11,637::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-96::DEBUG::2014-09-15 18:18:11,637::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-96::DEBUG::2014-09-15 18:18:11,637::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-96::DEBUG::2014-09-15 18:18:11,637::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-96::DEBUG::2014-09-15 18:18:11,637::task::993::Storage.TaskManager.Task::(_decref) Task=`c5d515fb-3434-414e-842a-6e5d8a1f651b`::ref 0 aborting False >Thread-96::DEBUG::2014-09-15 18:18:11,637::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-96::DEBUG::2014-09-15 18:18:11,637::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:11,965::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:11,982::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123806 s, 82.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:12,977::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:12,978::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-97::DEBUG::2014-09-15 18:18:12,979::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:13,990::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:14,007::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121535 s, 84.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:16,003::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:16,004::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-98::DEBUG::2014-09-15 18:18:16,005::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:16,014::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:16,031::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120438 s, 85.0 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:18,039::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:18,055::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121905 s, 84.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:18:18,751::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:18:18,757::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000908944 s, 4.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:19,025::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:19,027::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-99::DEBUG::2014-09-15 18:18:19,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`93792174-5ceb-4810-a44d-f83b3f49a8d0`::moving from state init -> state preparing >Thread-99::INFO::2014-09-15 18:18:19,031::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-99::INFO::2014-09-15 18:18:19,031::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010501', 'lastCheck': '8.9', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000908944', 'lastCheck': '0.3', 'valid': True}} >Thread-99::DEBUG::2014-09-15 18:18:19,032::task::1191::Storage.TaskManager.Task::(prepare) Task=`93792174-5ceb-4810-a44d-f83b3f49a8d0`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010501', 'lastCheck': '8.9', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000908944', 'lastCheck': '0.3', 'valid': True}} >Thread-99::DEBUG::2014-09-15 18:18:19,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`93792174-5ceb-4810-a44d-f83b3f49a8d0`::moving from state preparing -> state finished >Thread-99::DEBUG::2014-09-15 18:18:19,033::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-99::DEBUG::2014-09-15 18:18:19,033::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-99::DEBUG::2014-09-15 18:18:19,033::task::993::Storage.TaskManager.Task::(_decref) Task=`93792174-5ceb-4810-a44d-f83b3f49a8d0`::ref 0 aborting False >Thread-99::DEBUG::2014-09-15 18:18:19,036::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:19,045::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:19,046::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-100::DEBUG::2014-09-15 18:18:19,047::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:20,063::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:20,088::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.020336 s, 50.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:18:20,121::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:18:20,126::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00089907 s, 4.6 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:18:20,128::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:20,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:20,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:20,128::__init__::232::IOProcess::(_processLogs) (25) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:20,128::__init__::232::IOProcess::(_processLogs) (25) Queuing response >Thread-59::DEBUG::2014-09-15 18:18:20,129::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:20,129::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:20,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:20,130::__init__::232::IOProcess::(_processLogs) (26) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:20,130::__init__::232::IOProcess::(_processLogs) (26) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:21,718::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:21,719::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-101::DEBUG::2014-09-15 18:18:21,719::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-101::DEBUG::2014-09-15 18:18:21,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`05777588-deaf-4038-98ea-9aa95614c7e3`::moving from state init -> state preparing >Thread-101::INFO::2014-09-15 18:18:21,720::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-101::INFO::2014-09-15 18:18:21,720::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-101::DEBUG::2014-09-15 18:18:21,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`05777588-deaf-4038-98ea-9aa95614c7e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-101::DEBUG::2014-09-15 18:18:21,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`05777588-deaf-4038-98ea-9aa95614c7e3`::moving from state preparing -> state finished >Thread-101::DEBUG::2014-09-15 18:18:21,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-101::DEBUG::2014-09-15 18:18:21,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-101::DEBUG::2014-09-15 18:18:21,721::task::993::Storage.TaskManager.Task::(_decref) Task=`05777588-deaf-4038-98ea-9aa95614c7e3`::ref 0 aborting False >Thread-101::DEBUG::2014-09-15 18:18:21,721::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-101::DEBUG::2014-09-15 18:18:21,721::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:21,728::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-102::DEBUG::2014-09-15 18:18:21,729::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:21,729::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-102::DEBUG::2014-09-15 18:18:21,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`2530add1-d78a-4b59-b90f-226c7f692767`::moving from state init -> state preparing >Thread-102::INFO::2014-09-15 18:18:21,730::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-102::DEBUG::2014-09-15 18:18:21,730::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`70faae04-a17b-4b68-b96f-7d81df6b8a2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-102::DEBUG::2014-09-15 18:18:21,730::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-102::DEBUG::2014-09-15 18:18:21,730::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-102::DEBUG::2014-09-15 18:18:21,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`70faae04-a17b-4b68-b96f-7d81df6b8a2b`::Granted request >Thread-102::DEBUG::2014-09-15 18:18:21,731::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2530add1-d78a-4b59-b90f-226c7f692767`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-102::DEBUG::2014-09-15 18:18:21,731::task::993::Storage.TaskManager.Task::(_decref) Task=`2530add1-d78a-4b59-b90f-226c7f692767`::ref 1 aborting False >Thread-102::INFO::2014-09-15 18:18:21,731::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-102::DEBUG::2014-09-15 18:18:21,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`2530add1-d78a-4b59-b90f-226c7f692767`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-102::DEBUG::2014-09-15 18:18:21,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`2530add1-d78a-4b59-b90f-226c7f692767`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-09-15 18:18:21,731::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-102::DEBUG::2014-09-15 18:18:21,731::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-09-15 18:18:21,731::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-102::DEBUG::2014-09-15 18:18:21,732::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-102::DEBUG::2014-09-15 18:18:21,732::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-102::DEBUG::2014-09-15 18:18:21,732::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-102::DEBUG::2014-09-15 18:18:21,732::task::993::Storage.TaskManager.Task::(_decref) Task=`2530add1-d78a-4b59-b90f-226c7f692767`::ref 0 aborting False >Thread-102::DEBUG::2014-09-15 18:18:21,732::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-102::DEBUG::2014-09-15 18:18:21,732::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:22,096::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:22,113::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119029 s, 86.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:22,119::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:22,120::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-103::DEBUG::2014-09-15 18:18:22,121::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:24,121::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:24,142::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160155 s, 63.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:25,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:25,127::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-104::DEBUG::2014-09-15 18:18:25,128::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:26,149::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:26,167::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122819 s, 83.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:28,134::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:28,134::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-105::DEBUG::2014-09-15 18:18:28,135::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:28,175::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:28,192::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117539 s, 87.1 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:18:28,758::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:18:28,763::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107524 s, 3.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:18:30,131::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:18:30,136::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000886706 s, 4.6 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:18:30,137::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:30,138::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:30,138::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) (27) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) (27) Queuing response >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) (28) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:30,139::__init__::232::IOProcess::(_processLogs) (28) Queuing response >Dummy-65::DEBUG::2014-09-15 18:18:30,199::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:30,220::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156471 s, 65.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:31,141::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:31,141::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-106::DEBUG::2014-09-15 18:18:31,142::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:31,753::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:31,754::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-107::DEBUG::2014-09-15 18:18:31,754::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-107::DEBUG::2014-09-15 18:18:31,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`2495836b-b0e6-4464-8cf5-00f30c25cb8b`::moving from state init -> state preparing >Thread-107::INFO::2014-09-15 18:18:31,755::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-107::INFO::2014-09-15 18:18:31,755::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-107::DEBUG::2014-09-15 18:18:31,755::task::1191::Storage.TaskManager.Task::(prepare) Task=`2495836b-b0e6-4464-8cf5-00f30c25cb8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-107::DEBUG::2014-09-15 18:18:31,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`2495836b-b0e6-4464-8cf5-00f30c25cb8b`::moving from state preparing -> state finished >Thread-107::DEBUG::2014-09-15 18:18:31,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-107::DEBUG::2014-09-15 18:18:31,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-107::DEBUG::2014-09-15 18:18:31,756::task::993::Storage.TaskManager.Task::(_decref) Task=`2495836b-b0e6-4464-8cf5-00f30c25cb8b`::ref 0 aborting False >Thread-107::DEBUG::2014-09-15 18:18:31,756::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-107::DEBUG::2014-09-15 18:18:31,756::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:31,760::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-108::DEBUG::2014-09-15 18:18:31,761::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:31,761::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-108::DEBUG::2014-09-15 18:18:31,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff9fd065-60ff-45af-9b6d-9b64b14bc020`::moving from state init -> state preparing >Thread-108::INFO::2014-09-15 18:18:31,762::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-108::DEBUG::2014-09-15 18:18:31,762::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`4b764da0-20c8-412d-81c3-bf5660948470`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-108::DEBUG::2014-09-15 18:18:31,762::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-108::DEBUG::2014-09-15 18:18:31,763::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-108::DEBUG::2014-09-15 18:18:31,763::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`4b764da0-20c8-412d-81c3-bf5660948470`::Granted request >Thread-108::DEBUG::2014-09-15 18:18:31,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff9fd065-60ff-45af-9b6d-9b64b14bc020`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-108::DEBUG::2014-09-15 18:18:31,763::task::993::Storage.TaskManager.Task::(_decref) Task=`ff9fd065-60ff-45af-9b6d-9b64b14bc020`::ref 1 aborting False >Thread-108::INFO::2014-09-15 18:18:31,763::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-108::DEBUG::2014-09-15 18:18:31,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff9fd065-60ff-45af-9b6d-9b64b14bc020`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-108::DEBUG::2014-09-15 18:18:31,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff9fd065-60ff-45af-9b6d-9b64b14bc020`::moving from state preparing -> state finished >Thread-108::DEBUG::2014-09-15 18:18:31,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-108::DEBUG::2014-09-15 18:18:31,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-108::DEBUG::2014-09-15 18:18:31,764::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-108::DEBUG::2014-09-15 18:18:31,764::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-108::DEBUG::2014-09-15 18:18:31,764::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-108::DEBUG::2014-09-15 18:18:31,764::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-108::DEBUG::2014-09-15 18:18:31,764::task::993::Storage.TaskManager.Task::(_decref) Task=`ff9fd065-60ff-45af-9b6d-9b64b14bc020`::ref 0 aborting False >Thread-108::DEBUG::2014-09-15 18:18:31,764::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-108::DEBUG::2014-09-15 18:18:31,764::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:32,227::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:32,244::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121885 s, 84.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:34,151::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:34,152::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-109::DEBUG::2014-09-15 18:18:34,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`047201fd-4655-4f47-806c-e1829c54c280`::moving from state init -> state preparing >Thread-109::INFO::2014-09-15 18:18:34,153::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-109::INFO::2014-09-15 18:18:34,153::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000886706', 'lastCheck': '4.0', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107524', 'lastCheck': '5.4', 'valid': True}} >Thread-109::DEBUG::2014-09-15 18:18:34,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`047201fd-4655-4f47-806c-e1829c54c280`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000886706', 'lastCheck': '4.0', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107524', 'lastCheck': '5.4', 'valid': True}} >Thread-109::DEBUG::2014-09-15 18:18:34,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`047201fd-4655-4f47-806c-e1829c54c280`::moving from state preparing -> state finished >Thread-109::DEBUG::2014-09-15 18:18:34,153::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-109::DEBUG::2014-09-15 18:18:34,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2014-09-15 18:18:34,153::task::993::Storage.TaskManager.Task::(_decref) Task=`047201fd-4655-4f47-806c-e1829c54c280`::ref 0 aborting False >Thread-109::DEBUG::2014-09-15 18:18:34,154::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:34,179::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:34,179::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-110::DEBUG::2014-09-15 18:18:34,180::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:34,251::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:34,271::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0157887 s, 64.9 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:36,279::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:36,302::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179705 s, 57.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:37,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:37,246::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-111::DEBUG::2014-09-15 18:18:37,247::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:38,309::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:38,333::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184464 s, 55.5 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:18:38,764::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:18:38,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000836893 s, 4.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:18:40,139::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:18:40,144::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781952 s, 5.2 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:18:40,146::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:40,146::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:40,146::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:40,146::__init__::232::IOProcess::(_processLogs) (29) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:40,146::__init__::232::IOProcess::(_processLogs) (29) Queuing response >Thread-59::DEBUG::2014-09-15 18:18:40,147::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:40,147::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:40,147::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:40,147::__init__::232::IOProcess::(_processLogs) (30) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:40,147::__init__::232::IOProcess::(_processLogs) (30) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:40,255::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:40,256::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-112::DEBUG::2014-09-15 18:18:40,257::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:40,340::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:40,357::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120566 s, 84.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:41,793::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-113::DEBUG::2014-09-15 18:18:41,794::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:41,794::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-113::DEBUG::2014-09-15 18:18:41,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c21b7b9-8b0e-43a3-b0d4-916bcd06a268`::moving from state init -> state preparing >Thread-113::INFO::2014-09-15 18:18:41,795::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-113::INFO::2014-09-15 18:18:41,795::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-113::DEBUG::2014-09-15 18:18:41,796::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c21b7b9-8b0e-43a3-b0d4-916bcd06a268`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-113::DEBUG::2014-09-15 18:18:41,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c21b7b9-8b0e-43a3-b0d4-916bcd06a268`::moving from state preparing -> state finished >Thread-113::DEBUG::2014-09-15 18:18:41,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-113::DEBUG::2014-09-15 18:18:41,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-113::DEBUG::2014-09-15 18:18:41,796::task::993::Storage.TaskManager.Task::(_decref) Task=`9c21b7b9-8b0e-43a3-b0d4-916bcd06a268`::ref 0 aborting False >Thread-113::DEBUG::2014-09-15 18:18:41,796::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-113::DEBUG::2014-09-15 18:18:41,796::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:41,803::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:41,803::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-114::DEBUG::2014-09-15 18:18:41,803::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-114::DEBUG::2014-09-15 18:18:41,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`706df779-4dc7-43c6-ae20-eae5084ac5f3`::moving from state init -> state preparing >Thread-114::INFO::2014-09-15 18:18:41,804::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-114::DEBUG::2014-09-15 18:18:41,804::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`dedc675c-fec9-42a6-a7fc-35c4d58b90ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-114::DEBUG::2014-09-15 18:18:41,804::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-114::DEBUG::2014-09-15 18:18:41,805::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-114::DEBUG::2014-09-15 18:18:41,805::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`dedc675c-fec9-42a6-a7fc-35c4d58b90ce`::Granted request >Thread-114::DEBUG::2014-09-15 18:18:41,805::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`706df779-4dc7-43c6-ae20-eae5084ac5f3`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-114::DEBUG::2014-09-15 18:18:41,805::task::993::Storage.TaskManager.Task::(_decref) Task=`706df779-4dc7-43c6-ae20-eae5084ac5f3`::ref 1 aborting False >Thread-114::INFO::2014-09-15 18:18:41,805::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-114::DEBUG::2014-09-15 18:18:41,805::task::1191::Storage.TaskManager.Task::(prepare) Task=`706df779-4dc7-43c6-ae20-eae5084ac5f3`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-114::DEBUG::2014-09-15 18:18:41,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`706df779-4dc7-43c6-ae20-eae5084ac5f3`::moving from state preparing -> state finished >Thread-114::DEBUG::2014-09-15 18:18:41,806::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-114::DEBUG::2014-09-15 18:18:41,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-114::DEBUG::2014-09-15 18:18:41,806::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-114::DEBUG::2014-09-15 18:18:41,806::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-114::DEBUG::2014-09-15 18:18:41,806::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-114::DEBUG::2014-09-15 18:18:41,806::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-114::DEBUG::2014-09-15 18:18:41,806::task::993::Storage.TaskManager.Task::(_decref) Task=`706df779-4dc7-43c6-ae20-eae5084ac5f3`::ref 0 aborting False >Thread-114::DEBUG::2014-09-15 18:18:41,806::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-114::DEBUG::2014-09-15 18:18:41,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:42,365::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:42,384::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143057 s, 71.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:43,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:43,266::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-115::DEBUG::2014-09-15 18:18:43,267::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:44,392::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:44,417::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205812 s, 49.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:46,275::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:46,276::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-116::DEBUG::2014-09-15 18:18:46,277::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:46,425::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:46,441::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120933 s, 84.7 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:48,449::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:48,465::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116348 s, 88.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:18:48,770::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:18:48,776::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000979818 s, 4.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:49,283::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:49,285::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-117::DEBUG::2014-09-15 18:18:49,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b14ff50-bfad-47fb-9c5e-f7b89530fb88`::moving from state init -> state preparing >Thread-117::INFO::2014-09-15 18:18:49,290::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-117::INFO::2014-09-15 18:18:49,290::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781952', 'lastCheck': '9.1', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000979818', 'lastCheck': '0.5', 'valid': True}} >Thread-117::DEBUG::2014-09-15 18:18:49,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b14ff50-bfad-47fb-9c5e-f7b89530fb88`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781952', 'lastCheck': '9.1', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000979818', 'lastCheck': '0.5', 'valid': True}} >Thread-117::DEBUG::2014-09-15 18:18:49,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b14ff50-bfad-47fb-9c5e-f7b89530fb88`::moving from state preparing -> state finished >Thread-117::DEBUG::2014-09-15 18:18:49,292::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-117::DEBUG::2014-09-15 18:18:49,292::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-117::DEBUG::2014-09-15 18:18:49,293::task::993::Storage.TaskManager.Task::(_decref) Task=`4b14ff50-bfad-47fb-9c5e-f7b89530fb88`::ref 0 aborting False >Thread-117::DEBUG::2014-09-15 18:18:49,296::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:49,305::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:49,306::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-118::DEBUG::2014-09-15 18:18:49,308::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-15 18:18:50,148::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:18:50,153::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000852528 s, 4.8 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:18:50,154::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) (31) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) (31) Queuing response >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:18:50,155::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:18:50,156::__init__::232::IOProcess::(_processLogs) (32) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:18:50,156::__init__::232::IOProcess::(_processLogs) (32) Queuing response >Dummy-65::DEBUG::2014-09-15 18:18:50,473::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:50,490::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123619 s, 82.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:51,863::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-119::DEBUG::2014-09-15 18:18:51,864::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:51,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-119::DEBUG::2014-09-15 18:18:51,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`80edc6fa-b2f6-4031-a473-a2bee9a81126`::moving from state init -> state preparing >Thread-119::INFO::2014-09-15 18:18:51,865::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-119::INFO::2014-09-15 18:18:51,865::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-119::DEBUG::2014-09-15 18:18:51,865::task::1191::Storage.TaskManager.Task::(prepare) Task=`80edc6fa-b2f6-4031-a473-a2bee9a81126`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-119::DEBUG::2014-09-15 18:18:51,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`80edc6fa-b2f6-4031-a473-a2bee9a81126`::moving from state preparing -> state finished >Thread-119::DEBUG::2014-09-15 18:18:51,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-119::DEBUG::2014-09-15 18:18:51,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-119::DEBUG::2014-09-15 18:18:51,866::task::993::Storage.TaskManager.Task::(_decref) Task=`80edc6fa-b2f6-4031-a473-a2bee9a81126`::ref 0 aborting False >Thread-119::DEBUG::2014-09-15 18:18:51,866::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-119::DEBUG::2014-09-15 18:18:51,866::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:51,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-120::DEBUG::2014-09-15 18:18:51,870::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:18:51,870::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-120::DEBUG::2014-09-15 18:18:51,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`36587ddf-d8f2-4f92-8dfb-3c974ef61223`::moving from state init -> state preparing >Thread-120::INFO::2014-09-15 18:18:51,871::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-120::DEBUG::2014-09-15 18:18:51,871::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`0877dea0-2c51-4a43-afe8-b7c766e2a116`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-120::DEBUG::2014-09-15 18:18:51,871::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-120::DEBUG::2014-09-15 18:18:51,872::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-120::DEBUG::2014-09-15 18:18:51,872::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`0877dea0-2c51-4a43-afe8-b7c766e2a116`::Granted request >Thread-120::DEBUG::2014-09-15 18:18:51,872::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`36587ddf-d8f2-4f92-8dfb-3c974ef61223`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-120::DEBUG::2014-09-15 18:18:51,872::task::993::Storage.TaskManager.Task::(_decref) Task=`36587ddf-d8f2-4f92-8dfb-3c974ef61223`::ref 1 aborting False >Thread-120::INFO::2014-09-15 18:18:51,872::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-120::DEBUG::2014-09-15 18:18:51,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`36587ddf-d8f2-4f92-8dfb-3c974ef61223`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-120::DEBUG::2014-09-15 18:18:51,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`36587ddf-d8f2-4f92-8dfb-3c974ef61223`::moving from state preparing -> state finished >Thread-120::DEBUG::2014-09-15 18:18:51,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-120::DEBUG::2014-09-15 18:18:51,873::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-120::DEBUG::2014-09-15 18:18:51,873::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-120::DEBUG::2014-09-15 18:18:51,873::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-120::DEBUG::2014-09-15 18:18:51,873::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-120::DEBUG::2014-09-15 18:18:51,873::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-120::DEBUG::2014-09-15 18:18:51,873::task::993::Storage.TaskManager.Task::(_decref) Task=`36587ddf-d8f2-4f92-8dfb-3c974ef61223`::ref 0 aborting False >Thread-120::DEBUG::2014-09-15 18:18:51,873::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-120::DEBUG::2014-09-15 18:18:51,873::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:52,420::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:52,421::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-121::DEBUG::2014-09-15 18:18:52,421::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:52,498::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:52,724::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.221137 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:54,731::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:54,755::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193323 s, 53.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:55,432::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:55,433::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-122::DEBUG::2014-09-15 18:18:55,433::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:18:56,763::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:56,784::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0161834 s, 63.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:18:58,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:18:58,442::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-123::DEBUG::2014-09-15 18:18:58,443::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:18:58,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:18:58,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00104116 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:18:58,792::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:18:58,813::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017278 s, 59.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:19:00,156::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:19:00,161::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000910927 s, 4.5 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:19:00,162::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:00,162::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) (33) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) (33) Queuing response >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) (34) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:00,163::__init__::232::IOProcess::(_processLogs) (34) Queuing response >Dummy-65::DEBUG::2014-09-15 18:19:00,821::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:00,838::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119737 s, 85.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:01,491::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:01,492::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-124::DEBUG::2014-09-15 18:19:01,493::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:01,970::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-125::DEBUG::2014-09-15 18:19:01,971::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:01,971::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-125::DEBUG::2014-09-15 18:19:01,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4db7b2-7fcb-47bd-914e-69277dd612ac`::moving from state init -> state preparing >Thread-125::INFO::2014-09-15 18:19:01,972::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-125::INFO::2014-09-15 18:19:01,972::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-125::DEBUG::2014-09-15 18:19:01,972::task::1191::Storage.TaskManager.Task::(prepare) Task=`de4db7b2-7fcb-47bd-914e-69277dd612ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-125::DEBUG::2014-09-15 18:19:01,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4db7b2-7fcb-47bd-914e-69277dd612ac`::moving from state preparing -> state finished >Thread-125::DEBUG::2014-09-15 18:19:01,972::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-125::DEBUG::2014-09-15 18:19:01,972::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-125::DEBUG::2014-09-15 18:19:01,973::task::993::Storage.TaskManager.Task::(_decref) Task=`de4db7b2-7fcb-47bd-914e-69277dd612ac`::ref 0 aborting False >Thread-125::DEBUG::2014-09-15 18:19:01,973::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-125::DEBUG::2014-09-15 18:19:01,973::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:01,979::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:01,980::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-126::DEBUG::2014-09-15 18:19:01,980::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-126::DEBUG::2014-09-15 18:19:01,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`006349e9-a3cd-4689-933d-a18b436e92cf`::moving from state init -> state preparing >Thread-126::INFO::2014-09-15 18:19:01,981::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-126::DEBUG::2014-09-15 18:19:01,981::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`23c710d3-bb4e-4634-8943-07eff8a3a452`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-126::DEBUG::2014-09-15 18:19:01,981::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-126::DEBUG::2014-09-15 18:19:01,981::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-126::DEBUG::2014-09-15 18:19:01,981::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`23c710d3-bb4e-4634-8943-07eff8a3a452`::Granted request >Thread-126::DEBUG::2014-09-15 18:19:01,981::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`006349e9-a3cd-4689-933d-a18b436e92cf`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-126::DEBUG::2014-09-15 18:19:01,981::task::993::Storage.TaskManager.Task::(_decref) Task=`006349e9-a3cd-4689-933d-a18b436e92cf`::ref 1 aborting False >Thread-126::INFO::2014-09-15 18:19:01,982::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-126::DEBUG::2014-09-15 18:19:01,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`006349e9-a3cd-4689-933d-a18b436e92cf`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-126::DEBUG::2014-09-15 18:19:01,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`006349e9-a3cd-4689-933d-a18b436e92cf`::moving from state preparing -> state finished >Thread-126::DEBUG::2014-09-15 18:19:01,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-126::DEBUG::2014-09-15 18:19:01,982::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-126::DEBUG::2014-09-15 18:19:01,982::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-126::DEBUG::2014-09-15 18:19:01,982::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-126::DEBUG::2014-09-15 18:19:01,982::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-126::DEBUG::2014-09-15 18:19:01,982::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-126::DEBUG::2014-09-15 18:19:01,983::task::993::Storage.TaskManager.Task::(_decref) Task=`006349e9-a3cd-4689-933d-a18b436e92cf`::ref 0 aborting False >Thread-126::DEBUG::2014-09-15 18:19:01,983::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-126::DEBUG::2014-09-15 18:19:01,983::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:02,846::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:02,869::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183498 s, 55.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:04,502::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:04,502::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-127::DEBUG::2014-09-15 18:19:04,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe918f6e-05a8-4a61-a84b-26957fe07b51`::moving from state init -> state preparing >Thread-127::INFO::2014-09-15 18:19:04,503::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-127::INFO::2014-09-15 18:19:04,504::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910927', 'lastCheck': '4.3', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104116', 'lastCheck': '5.7', 'valid': True}} >Thread-127::DEBUG::2014-09-15 18:19:04,504::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe918f6e-05a8-4a61-a84b-26957fe07b51`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910927', 'lastCheck': '4.3', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104116', 'lastCheck': '5.7', 'valid': True}} >Thread-127::DEBUG::2014-09-15 18:19:04,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe918f6e-05a8-4a61-a84b-26957fe07b51`::moving from state preparing -> state finished >Thread-127::DEBUG::2014-09-15 18:19:04,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-127::DEBUG::2014-09-15 18:19:04,504::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-127::DEBUG::2014-09-15 18:19:04,504::task::993::Storage.TaskManager.Task::(_decref) Task=`fe918f6e-05a8-4a61-a84b-26957fe07b51`::ref 0 aborting False >Thread-127::DEBUG::2014-09-15 18:19:04,505::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:04,518::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:04,519::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-128::DEBUG::2014-09-15 18:19:04,520::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:04,877::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:04,894::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124098 s, 82.5 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:06,900::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:06,921::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0157245 s, 65.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:07,635::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:07,636::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-129::DEBUG::2014-09-15 18:19:07,637::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:19:08,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:19:08,789::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000857465 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:08,929::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:08,945::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0113462 s, 90.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:19:10,164::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:19:10,170::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103962 s, 3.9 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:19:10,171::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) (35) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) (35) Queuing response >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) (36) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:10,172::__init__::232::IOProcess::(_processLogs) (36) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:10,648::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:10,649::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-130::DEBUG::2014-09-15 18:19:10,650::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:10,952::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:10,969::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120343 s, 85.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:12,033::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:12,034::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-131::DEBUG::2014-09-15 18:19:12,034::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-131::DEBUG::2014-09-15 18:19:12,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc69a7ee-19db-4061-bc1c-8d506ee7ac77`::moving from state init -> state preparing >Thread-131::INFO::2014-09-15 18:19:12,035::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-131::INFO::2014-09-15 18:19:12,035::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-131::DEBUG::2014-09-15 18:19:12,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc69a7ee-19db-4061-bc1c-8d506ee7ac77`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-131::DEBUG::2014-09-15 18:19:12,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc69a7ee-19db-4061-bc1c-8d506ee7ac77`::moving from state preparing -> state finished >Thread-131::DEBUG::2014-09-15 18:19:12,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-131::DEBUG::2014-09-15 18:19:12,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-131::DEBUG::2014-09-15 18:19:12,035::task::993::Storage.TaskManager.Task::(_decref) Task=`dc69a7ee-19db-4061-bc1c-8d506ee7ac77`::ref 0 aborting False >Thread-131::DEBUG::2014-09-15 18:19:12,036::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-131::DEBUG::2014-09-15 18:19:12,036::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:12,039::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-132::DEBUG::2014-09-15 18:19:12,040::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:12,040::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-132::DEBUG::2014-09-15 18:19:12,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`68400926-c5ae-44e5-bff4-3a7cbb72cba5`::moving from state init -> state preparing >Thread-132::INFO::2014-09-15 18:19:12,041::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-132::DEBUG::2014-09-15 18:19:12,041::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`32a67c8a-3441-44d1-92fc-f231daaff090`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-132::DEBUG::2014-09-15 18:19:12,042::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-132::DEBUG::2014-09-15 18:19:12,042::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-132::DEBUG::2014-09-15 18:19:12,042::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`32a67c8a-3441-44d1-92fc-f231daaff090`::Granted request >Thread-132::DEBUG::2014-09-15 18:19:12,042::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68400926-c5ae-44e5-bff4-3a7cbb72cba5`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-132::DEBUG::2014-09-15 18:19:12,042::task::993::Storage.TaskManager.Task::(_decref) Task=`68400926-c5ae-44e5-bff4-3a7cbb72cba5`::ref 1 aborting False >Thread-132::INFO::2014-09-15 18:19:12,042::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-132::DEBUG::2014-09-15 18:19:12,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`68400926-c5ae-44e5-bff4-3a7cbb72cba5`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-132::DEBUG::2014-09-15 18:19:12,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`68400926-c5ae-44e5-bff4-3a7cbb72cba5`::moving from state preparing -> state finished >Thread-132::DEBUG::2014-09-15 18:19:12,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-132::DEBUG::2014-09-15 18:19:12,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-132::DEBUG::2014-09-15 18:19:12,043::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-132::DEBUG::2014-09-15 18:19:12,043::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-132::DEBUG::2014-09-15 18:19:12,043::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-132::DEBUG::2014-09-15 18:19:12,043::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-132::DEBUG::2014-09-15 18:19:12,043::task::993::Storage.TaskManager.Task::(_decref) Task=`68400926-c5ae-44e5-bff4-3a7cbb72cba5`::ref 0 aborting False >Thread-132::DEBUG::2014-09-15 18:19:12,043::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-132::DEBUG::2014-09-15 18:19:12,044::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:12,976::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:12,993::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118283 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:13,662::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:13,663::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-133::DEBUG::2014-09-15 18:19:13,664::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:15,001::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:15,022::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169005 s, 60.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:16,674::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:16,675::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-134::DEBUG::2014-09-15 18:19:16,676::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:17,030::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:17,047::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012335 s, 83.0 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:19:18,790::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:19:18,795::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000875949 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:19,055::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:19,081::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186641 s, 54.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:19,683::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:19,684::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-135::DEBUG::2014-09-15 18:19:19,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`c047fcf4-2b5b-4dca-a729-f880586f7b7f`::moving from state init -> state preparing >Thread-135::INFO::2014-09-15 18:19:19,687::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-135::INFO::2014-09-15 18:19:19,688::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103962', 'lastCheck': '9.5', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000875949', 'lastCheck': '0.9', 'valid': True}} >Thread-135::DEBUG::2014-09-15 18:19:19,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`c047fcf4-2b5b-4dca-a729-f880586f7b7f`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103962', 'lastCheck': '9.5', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000875949', 'lastCheck': '0.9', 'valid': True}} >Thread-135::DEBUG::2014-09-15 18:19:19,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`c047fcf4-2b5b-4dca-a729-f880586f7b7f`::moving from state preparing -> state finished >Thread-135::DEBUG::2014-09-15 18:19:19,689::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-135::DEBUG::2014-09-15 18:19:19,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-135::DEBUG::2014-09-15 18:19:19,689::task::993::Storage.TaskManager.Task::(_decref) Task=`c047fcf4-2b5b-4dca-a729-f880586f7b7f`::ref 0 aborting False >Thread-135::DEBUG::2014-09-15 18:19:19,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:19,699::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:19,699::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-136::DEBUG::2014-09-15 18:19:19,701::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-15 18:19:20,173::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:19:20,178::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00080854 s, 5.1 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:19:20,180::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:20,180::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:20,180::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:20,180::__init__::232::IOProcess::(_processLogs) (37) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:20,181::__init__::232::IOProcess::(_processLogs) (37) Queuing response >Thread-59::DEBUG::2014-09-15 18:19:20,181::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:20,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:20,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:20,182::__init__::232::IOProcess::(_processLogs) (38) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:20,182::__init__::232::IOProcess::(_processLogs) (38) Queuing response >Dummy-65::DEBUG::2014-09-15 18:19:21,138::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:21,154::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0115056 s, 89.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:22,105::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-137::DEBUG::2014-09-15 18:19:22,106::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:22,106::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-137::DEBUG::2014-09-15 18:19:22,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a9d5de5-45ac-4f88-9668-ac9a8f6e921f`::moving from state init -> state preparing >Thread-137::INFO::2014-09-15 18:19:22,108::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-137::INFO::2014-09-15 18:19:22,108::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-137::DEBUG::2014-09-15 18:19:22,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a9d5de5-45ac-4f88-9668-ac9a8f6e921f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-137::DEBUG::2014-09-15 18:19:22,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a9d5de5-45ac-4f88-9668-ac9a8f6e921f`::moving from state preparing -> state finished >Thread-137::DEBUG::2014-09-15 18:19:22,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-137::DEBUG::2014-09-15 18:19:22,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-137::DEBUG::2014-09-15 18:19:22,108::task::993::Storage.TaskManager.Task::(_decref) Task=`9a9d5de5-45ac-4f88-9668-ac9a8f6e921f`::ref 0 aborting False >Thread-137::DEBUG::2014-09-15 18:19:22,109::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-137::DEBUG::2014-09-15 18:19:22,109::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:22,118::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:22,119::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-138::DEBUG::2014-09-15 18:19:22,119::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-138::DEBUG::2014-09-15 18:19:22,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e8b4f25-27e1-47af-b9b3-25127bd7ed02`::moving from state init -> state preparing >Thread-138::INFO::2014-09-15 18:19:22,119::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-138::DEBUG::2014-09-15 18:19:22,120::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`14a6c0a9-5406-416a-af73-9cb31d1f9f63`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-138::DEBUG::2014-09-15 18:19:22,120::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-138::DEBUG::2014-09-15 18:19:22,120::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-138::DEBUG::2014-09-15 18:19:22,120::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`14a6c0a9-5406-416a-af73-9cb31d1f9f63`::Granted request >Thread-138::DEBUG::2014-09-15 18:19:22,120::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e8b4f25-27e1-47af-b9b3-25127bd7ed02`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-138::DEBUG::2014-09-15 18:19:22,120::task::993::Storage.TaskManager.Task::(_decref) Task=`6e8b4f25-27e1-47af-b9b3-25127bd7ed02`::ref 1 aborting False >Thread-138::INFO::2014-09-15 18:19:22,121::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-138::DEBUG::2014-09-15 18:19:22,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e8b4f25-27e1-47af-b9b3-25127bd7ed02`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-138::DEBUG::2014-09-15 18:19:22,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e8b4f25-27e1-47af-b9b3-25127bd7ed02`::moving from state preparing -> state finished >Thread-138::DEBUG::2014-09-15 18:19:22,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-138::DEBUG::2014-09-15 18:19:22,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2014-09-15 18:19:22,121::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-138::DEBUG::2014-09-15 18:19:22,121::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-138::DEBUG::2014-09-15 18:19:22,121::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-138::DEBUG::2014-09-15 18:19:22,121::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-138::DEBUG::2014-09-15 18:19:22,121::task::993::Storage.TaskManager.Task::(_decref) Task=`6e8b4f25-27e1-47af-b9b3-25127bd7ed02`::ref 0 aborting False >Thread-138::DEBUG::2014-09-15 18:19:22,122::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-138::DEBUG::2014-09-15 18:19:22,122::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:22,805::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:22,805::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-139::DEBUG::2014-09-15 18:19:22,806::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:23,162::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:23,182::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0154439 s, 66.3 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:25,190::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:25,212::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173247 s, 59.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:25,815::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:25,816::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-140::DEBUG::2014-09-15 18:19:25,817::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:27,220::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:27,240::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0161946 s, 63.2 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:19:28,797::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:19:28,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999972 s, 4.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:28,823::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:28,824::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-141::DEBUG::2014-09-15 18:19:28,825::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:29,248::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:29,269::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0154251 s, 66.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:19:30,182::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:19:30,188::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000994442 s, 4.1 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:19:30,189::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:30,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:30,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:30,190::__init__::232::IOProcess::(_processLogs) (39) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:30,190::__init__::232::IOProcess::(_processLogs) (39) Queuing response >Thread-59::DEBUG::2014-09-15 18:19:30,190::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:30,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:30,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:30,191::__init__::232::IOProcess::(_processLogs) (40) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:30,191::__init__::232::IOProcess::(_processLogs) (40) Queuing response >Dummy-65::DEBUG::2014-09-15 18:19:31,276::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:31,300::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195142 s, 52.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:31,833::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:31,834::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-142::DEBUG::2014-09-15 18:19:31,835::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:32,168::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-143::DEBUG::2014-09-15 18:19:32,169::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:32,169::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-143::DEBUG::2014-09-15 18:19:32,170::task::595::Storage.TaskManager.Task::(_updateState) Task=`acf2798e-6f64-4db2-8c2a-239b77b28a8c`::moving from state init -> state preparing >Thread-143::INFO::2014-09-15 18:19:32,170::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-143::INFO::2014-09-15 18:19:32,170::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-143::DEBUG::2014-09-15 18:19:32,170::task::1191::Storage.TaskManager.Task::(prepare) Task=`acf2798e-6f64-4db2-8c2a-239b77b28a8c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-143::DEBUG::2014-09-15 18:19:32,170::task::595::Storage.TaskManager.Task::(_updateState) Task=`acf2798e-6f64-4db2-8c2a-239b77b28a8c`::moving from state preparing -> state finished >Thread-143::DEBUG::2014-09-15 18:19:32,170::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-143::DEBUG::2014-09-15 18:19:32,170::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-143::DEBUG::2014-09-15 18:19:32,170::task::993::Storage.TaskManager.Task::(_decref) Task=`acf2798e-6f64-4db2-8c2a-239b77b28a8c`::ref 0 aborting False >Thread-143::DEBUG::2014-09-15 18:19:32,171::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-143::DEBUG::2014-09-15 18:19:32,171::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:32,174::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-144::DEBUG::2014-09-15 18:19:32,175::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:32,175::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-144::DEBUG::2014-09-15 18:19:32,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`e835a35c-a1a1-44ab-9bd7-c07062b513f0`::moving from state init -> state preparing >Thread-144::INFO::2014-09-15 18:19:32,176::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-144::DEBUG::2014-09-15 18:19:32,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`5f30968b-cb01-4ee7-af50-dc6f227739d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-144::DEBUG::2014-09-15 18:19:32,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-144::DEBUG::2014-09-15 18:19:32,176::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-144::DEBUG::2014-09-15 18:19:32,177::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`5f30968b-cb01-4ee7-af50-dc6f227739d9`::Granted request >Thread-144::DEBUG::2014-09-15 18:19:32,177::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e835a35c-a1a1-44ab-9bd7-c07062b513f0`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-144::DEBUG::2014-09-15 18:19:32,177::task::993::Storage.TaskManager.Task::(_decref) Task=`e835a35c-a1a1-44ab-9bd7-c07062b513f0`::ref 1 aborting False >Thread-144::INFO::2014-09-15 18:19:32,177::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-144::DEBUG::2014-09-15 18:19:32,177::task::1191::Storage.TaskManager.Task::(prepare) Task=`e835a35c-a1a1-44ab-9bd7-c07062b513f0`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-144::DEBUG::2014-09-15 18:19:32,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`e835a35c-a1a1-44ab-9bd7-c07062b513f0`::moving from state preparing -> state finished >Thread-144::DEBUG::2014-09-15 18:19:32,177::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-144::DEBUG::2014-09-15 18:19:32,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2014-09-15 18:19:32,178::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-144::DEBUG::2014-09-15 18:19:32,178::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-144::DEBUG::2014-09-15 18:19:32,178::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-144::DEBUG::2014-09-15 18:19:32,178::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-144::DEBUG::2014-09-15 18:19:32,178::task::993::Storage.TaskManager.Task::(_decref) Task=`e835a35c-a1a1-44ab-9bd7-c07062b513f0`::ref 0 aborting False >Thread-144::DEBUG::2014-09-15 18:19:32,178::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-144::DEBUG::2014-09-15 18:19:32,178::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:33,308::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:33,327::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144521 s, 70.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:34,847::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:34,847::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-145::DEBUG::2014-09-15 18:19:34,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c2e1cbb-a279-4d3e-ac5e-decddaec78f0`::moving from state init -> state preparing >Thread-145::INFO::2014-09-15 18:19:34,848::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-145::INFO::2014-09-15 18:19:34,849::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000994442', 'lastCheck': '4.7', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000999972', 'lastCheck': '6.0', 'valid': True}} >Thread-145::DEBUG::2014-09-15 18:19:34,849::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c2e1cbb-a279-4d3e-ac5e-decddaec78f0`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000994442', 'lastCheck': '4.7', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000999972', 'lastCheck': '6.0', 'valid': True}} >Thread-145::DEBUG::2014-09-15 18:19:34,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c2e1cbb-a279-4d3e-ac5e-decddaec78f0`::moving from state preparing -> state finished >Thread-145::DEBUG::2014-09-15 18:19:34,849::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-145::DEBUG::2014-09-15 18:19:34,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-145::DEBUG::2014-09-15 18:19:34,849::task::993::Storage.TaskManager.Task::(_decref) Task=`5c2e1cbb-a279-4d3e-ac5e-decddaec78f0`::ref 0 aborting False >Thread-145::DEBUG::2014-09-15 18:19:34,850::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:34,870::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:34,871::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-146::DEBUG::2014-09-15 18:19:34,872::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:35,335::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:35,356::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163823 s, 62.5 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:37,364::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:37,381::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119493 s, 85.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:37,969::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:37,970::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-147::DEBUG::2014-09-15 18:19:37,971::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:19:38,804::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:19:38,809::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000959033 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:39,389::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:39,409::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158198 s, 64.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:19:40,191::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:19:40,196::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806544 s, 5.1 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:19:40,198::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:40,198::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:40,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) (41) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) (41) Queuing response >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) (42) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:40,199::__init__::232::IOProcess::(_processLogs) (42) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:40,980::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:40,981::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-148::DEBUG::2014-09-15 18:19:40,982::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:41,417::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:41,434::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123727 s, 82.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:42,234::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-149::DEBUG::2014-09-15 18:19:42,235::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:42,235::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-149::DEBUG::2014-09-15 18:19:42,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`652c1a48-5728-4b46-9e47-48a8c8fb6732`::moving from state init -> state preparing >Thread-149::INFO::2014-09-15 18:19:42,236::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-149::INFO::2014-09-15 18:19:42,236::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-149::DEBUG::2014-09-15 18:19:42,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`652c1a48-5728-4b46-9e47-48a8c8fb6732`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-149::DEBUG::2014-09-15 18:19:42,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`652c1a48-5728-4b46-9e47-48a8c8fb6732`::moving from state preparing -> state finished >Thread-149::DEBUG::2014-09-15 18:19:42,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-149::DEBUG::2014-09-15 18:19:42,237::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-149::DEBUG::2014-09-15 18:19:42,237::task::993::Storage.TaskManager.Task::(_decref) Task=`652c1a48-5728-4b46-9e47-48a8c8fb6732`::ref 0 aborting False >Thread-149::DEBUG::2014-09-15 18:19:42,237::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-149::DEBUG::2014-09-15 18:19:42,237::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:42,245::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:42,246::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-150::DEBUG::2014-09-15 18:19:42,246::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-150::DEBUG::2014-09-15 18:19:42,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`a465dbc3-e0bf-4285-af31-ff1a98976829`::moving from state init -> state preparing >Thread-150::INFO::2014-09-15 18:19:42,246::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-150::DEBUG::2014-09-15 18:19:42,247::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`a1757182-23d1-4ae7-a544-8aed49ec83ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-150::DEBUG::2014-09-15 18:19:42,247::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-150::DEBUG::2014-09-15 18:19:42,247::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-150::DEBUG::2014-09-15 18:19:42,247::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`a1757182-23d1-4ae7-a544-8aed49ec83ae`::Granted request >Thread-150::DEBUG::2014-09-15 18:19:42,247::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a465dbc3-e0bf-4285-af31-ff1a98976829`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-150::DEBUG::2014-09-15 18:19:42,247::task::993::Storage.TaskManager.Task::(_decref) Task=`a465dbc3-e0bf-4285-af31-ff1a98976829`::ref 1 aborting False >Thread-150::INFO::2014-09-15 18:19:42,248::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-150::DEBUG::2014-09-15 18:19:42,248::task::1191::Storage.TaskManager.Task::(prepare) Task=`a465dbc3-e0bf-4285-af31-ff1a98976829`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-150::DEBUG::2014-09-15 18:19:42,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`a465dbc3-e0bf-4285-af31-ff1a98976829`::moving from state preparing -> state finished >Thread-150::DEBUG::2014-09-15 18:19:42,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-150::DEBUG::2014-09-15 18:19:42,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2014-09-15 18:19:42,248::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-150::DEBUG::2014-09-15 18:19:42,248::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-150::DEBUG::2014-09-15 18:19:42,248::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-150::DEBUG::2014-09-15 18:19:42,248::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-150::DEBUG::2014-09-15 18:19:42,248::task::993::Storage.TaskManager.Task::(_decref) Task=`a465dbc3-e0bf-4285-af31-ff1a98976829`::ref 0 aborting False >Thread-150::DEBUG::2014-09-15 18:19:42,249::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-150::DEBUG::2014-09-15 18:19:42,249::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:43,442::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:43,458::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119183 s, 85.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:43,991::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:43,993::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-151::DEBUG::2014-09-15 18:19:43,993::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:45,466::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:45,485::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148111 s, 69.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:47,000::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:47,001::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-152::DEBUG::2014-09-15 18:19:47,002::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:47,493::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:47,510::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122829 s, 83.4 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:19:48,811::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:19:48,817::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000947025 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:49,518::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:49,538::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152788 s, 67.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:50,008::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:50,008::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-153::DEBUG::2014-09-15 18:19:50,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`937741a0-1f29-4fd5-ae31-8f11b0ce7df2`::moving from state init -> state preparing >Thread-153::INFO::2014-09-15 18:19:50,010::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-153::INFO::2014-09-15 18:19:50,010::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806544', 'lastCheck': '9.8', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000947025', 'lastCheck': '1.2', 'valid': True}} >Thread-153::DEBUG::2014-09-15 18:19:50,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`937741a0-1f29-4fd5-ae31-8f11b0ce7df2`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806544', 'lastCheck': '9.8', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000947025', 'lastCheck': '1.2', 'valid': True}} >Thread-153::DEBUG::2014-09-15 18:19:50,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`937741a0-1f29-4fd5-ae31-8f11b0ce7df2`::moving from state preparing -> state finished >Thread-153::DEBUG::2014-09-15 18:19:50,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-153::DEBUG::2014-09-15 18:19:50,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-153::DEBUG::2014-09-15 18:19:50,010::task::993::Storage.TaskManager.Task::(_decref) Task=`937741a0-1f29-4fd5-ae31-8f11b0ce7df2`::ref 0 aborting False >Thread-153::DEBUG::2014-09-15 18:19:50,011::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:50,017::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:50,017::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-154::DEBUG::2014-09-15 18:19:50,018::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-15 18:19:50,200::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:19:50,205::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000912019 s, 4.5 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:19:50,207::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:50,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:50,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:50,207::__init__::232::IOProcess::(_processLogs) (43) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:50,207::__init__::232::IOProcess::(_processLogs) (43) Queuing response >Thread-59::DEBUG::2014-09-15 18:19:50,208::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:19:50,208::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:19:50,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:19:50,208::__init__::232::IOProcess::(_processLogs) (44) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:19:50,209::__init__::232::IOProcess::(_processLogs) (44) Queuing response >Dummy-65::DEBUG::2014-09-15 18:19:51,599::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:51,620::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158419 s, 64.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:52,308::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-155::DEBUG::2014-09-15 18:19:52,309::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:52,309::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-155::DEBUG::2014-09-15 18:19:52,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd26b85a-7b13-4714-b1f3-11fba06bd28a`::moving from state init -> state preparing >Thread-155::INFO::2014-09-15 18:19:52,310::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-155::INFO::2014-09-15 18:19:52,310::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-155::DEBUG::2014-09-15 18:19:52,310::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd26b85a-7b13-4714-b1f3-11fba06bd28a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-155::DEBUG::2014-09-15 18:19:52,310::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd26b85a-7b13-4714-b1f3-11fba06bd28a`::moving from state preparing -> state finished >Thread-155::DEBUG::2014-09-15 18:19:52,310::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-155::DEBUG::2014-09-15 18:19:52,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2014-09-15 18:19:52,311::task::993::Storage.TaskManager.Task::(_decref) Task=`dd26b85a-7b13-4714-b1f3-11fba06bd28a`::ref 0 aborting False >Thread-155::DEBUG::2014-09-15 18:19:52,311::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-155::DEBUG::2014-09-15 18:19:52,311::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:52,318::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-156::DEBUG::2014-09-15 18:19:52,319::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:19:52,319::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-156::DEBUG::2014-09-15 18:19:52,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`231fdf05-a600-47c1-bcd4-02987af1a0a5`::moving from state init -> state preparing >Thread-156::INFO::2014-09-15 18:19:52,320::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-156::DEBUG::2014-09-15 18:19:52,320::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`e108c92b-baaa-4d8d-bdce-3c3456428296`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-156::DEBUG::2014-09-15 18:19:52,320::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-156::DEBUG::2014-09-15 18:19:52,320::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-156::DEBUG::2014-09-15 18:19:52,321::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`e108c92b-baaa-4d8d-bdce-3c3456428296`::Granted request >Thread-156::DEBUG::2014-09-15 18:19:52,321::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`231fdf05-a600-47c1-bcd4-02987af1a0a5`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-156::DEBUG::2014-09-15 18:19:52,321::task::993::Storage.TaskManager.Task::(_decref) Task=`231fdf05-a600-47c1-bcd4-02987af1a0a5`::ref 1 aborting False >Thread-156::INFO::2014-09-15 18:19:52,321::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-156::DEBUG::2014-09-15 18:19:52,321::task::1191::Storage.TaskManager.Task::(prepare) Task=`231fdf05-a600-47c1-bcd4-02987af1a0a5`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-156::DEBUG::2014-09-15 18:19:52,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`231fdf05-a600-47c1-bcd4-02987af1a0a5`::moving from state preparing -> state finished >Thread-156::DEBUG::2014-09-15 18:19:52,321::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-156::DEBUG::2014-09-15 18:19:52,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-156::DEBUG::2014-09-15 18:19:52,322::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-156::DEBUG::2014-09-15 18:19:52,322::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-156::DEBUG::2014-09-15 18:19:52,322::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-156::DEBUG::2014-09-15 18:19:52,322::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-156::DEBUG::2014-09-15 18:19:52,322::task::993::Storage.TaskManager.Task::(_decref) Task=`231fdf05-a600-47c1-bcd4-02987af1a0a5`::ref 0 aborting False >Thread-156::DEBUG::2014-09-15 18:19:52,322::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-156::DEBUG::2014-09-15 18:19:52,322::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:53,089::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:53,090::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-157::DEBUG::2014-09-15 18:19:53,091::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:53,627::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:53,644::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119061 s, 86.0 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:19:55,651::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:55,672::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0161096 s, 63.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:56,100::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:56,101::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-158::DEBUG::2014-09-15 18:19:56,102::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:57,680::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:57,697::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01223 s, 83.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:19:58,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:19:58,824::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000920993 s, 4.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:19:59,109::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:19:59,110::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-159::DEBUG::2014-09-15 18:19:59,111::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:19:59,705::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:19:59,725::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0154202 s, 66.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:20:00,209::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:20:00,214::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000922608 s, 4.4 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:20:00,216::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:00,216::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:00,216::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:00,216::__init__::232::IOProcess::(_processLogs) (45) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:00,216::__init__::232::IOProcess::(_processLogs) (45) Queuing response >Thread-59::DEBUG::2014-09-15 18:20:00,217::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:00,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:00,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:00,217::__init__::232::IOProcess::(_processLogs) (46) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:00,217::__init__::232::IOProcess::(_processLogs) (46) Queuing response >Dummy-65::DEBUG::2014-09-15 18:20:01,732::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:01,753::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0157935 s, 64.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:02,117::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:02,118::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-160::DEBUG::2014-09-15 18:20:02,119::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:02,368::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:02,369::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-161::DEBUG::2014-09-15 18:20:02,369::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-161::DEBUG::2014-09-15 18:20:02,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`b952b833-8934-4e42-9b61-6bed17dd02c0`::moving from state init -> state preparing >Thread-161::INFO::2014-09-15 18:20:02,370::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-161::INFO::2014-09-15 18:20:02,370::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-161::DEBUG::2014-09-15 18:20:02,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`b952b833-8934-4e42-9b61-6bed17dd02c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-161::DEBUG::2014-09-15 18:20:02,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`b952b833-8934-4e42-9b61-6bed17dd02c0`::moving from state preparing -> state finished >Thread-161::DEBUG::2014-09-15 18:20:02,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2014-09-15 18:20:02,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2014-09-15 18:20:02,370::task::993::Storage.TaskManager.Task::(_decref) Task=`b952b833-8934-4e42-9b61-6bed17dd02c0`::ref 0 aborting False >Thread-161::DEBUG::2014-09-15 18:20:02,371::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-161::DEBUG::2014-09-15 18:20:02,371::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:02,374::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-162::DEBUG::2014-09-15 18:20:02,375::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:02,375::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-162::DEBUG::2014-09-15 18:20:02,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ff3aa6-9857-4a75-9e0b-17a6bb7d0e29`::moving from state init -> state preparing >Thread-162::INFO::2014-09-15 18:20:02,376::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-162::DEBUG::2014-09-15 18:20:02,376::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`51097262-d70a-484c-b9e0-79cfff555ab9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-162::DEBUG::2014-09-15 18:20:02,376::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-162::DEBUG::2014-09-15 18:20:02,377::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-162::DEBUG::2014-09-15 18:20:02,377::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`51097262-d70a-484c-b9e0-79cfff555ab9`::Granted request >Thread-162::DEBUG::2014-09-15 18:20:02,377::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04ff3aa6-9857-4a75-9e0b-17a6bb7d0e29`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-162::DEBUG::2014-09-15 18:20:02,377::task::993::Storage.TaskManager.Task::(_decref) Task=`04ff3aa6-9857-4a75-9e0b-17a6bb7d0e29`::ref 1 aborting False >Thread-162::INFO::2014-09-15 18:20:02,378::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-162::DEBUG::2014-09-15 18:20:02,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`04ff3aa6-9857-4a75-9e0b-17a6bb7d0e29`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-162::DEBUG::2014-09-15 18:20:02,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`04ff3aa6-9857-4a75-9e0b-17a6bb7d0e29`::moving from state preparing -> state finished >Thread-162::DEBUG::2014-09-15 18:20:02,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-162::DEBUG::2014-09-15 18:20:02,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-162::DEBUG::2014-09-15 18:20:02,378::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-162::DEBUG::2014-09-15 18:20:02,378::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-162::DEBUG::2014-09-15 18:20:02,378::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-162::DEBUG::2014-09-15 18:20:02,378::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-162::DEBUG::2014-09-15 18:20:02,379::task::993::Storage.TaskManager.Task::(_decref) Task=`04ff3aa6-9857-4a75-9e0b-17a6bb7d0e29`::ref 0 aborting False >Thread-162::DEBUG::2014-09-15 18:20:02,379::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-162::DEBUG::2014-09-15 18:20:02,379::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:03,761::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:03,781::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0154388 s, 66.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:05,127::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:05,128::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-163::DEBUG::2014-09-15 18:20:05,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ec74c7a-a6ed-4c39-a7ad-9b0561d9876b`::moving from state init -> state preparing >Thread-163::INFO::2014-09-15 18:20:05,129::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-163::INFO::2014-09-15 18:20:05,129::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000922608', 'lastCheck': '4.9', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000920993', 'lastCheck': '6.3', 'valid': True}} >Thread-163::DEBUG::2014-09-15 18:20:05,129::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ec74c7a-a6ed-4c39-a7ad-9b0561d9876b`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000922608', 'lastCheck': '4.9', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000920993', 'lastCheck': '6.3', 'valid': True}} >Thread-163::DEBUG::2014-09-15 18:20:05,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ec74c7a-a6ed-4c39-a7ad-9b0561d9876b`::moving from state preparing -> state finished >Thread-163::DEBUG::2014-09-15 18:20:05,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-163::DEBUG::2014-09-15 18:20:05,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-163::DEBUG::2014-09-15 18:20:05,129::task::993::Storage.TaskManager.Task::(_decref) Task=`0ec74c7a-a6ed-4c39-a7ad-9b0561d9876b`::ref 0 aborting False >Thread-163::DEBUG::2014-09-15 18:20:05,130::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:05,143::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:05,144::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-164::DEBUG::2014-09-15 18:20:05,145::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:05,789::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:05,808::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147748 s, 69.3 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:20:07,816::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:07,834::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013609 s, 75.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:08,226::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:08,227::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-165::DEBUG::2014-09-15 18:20:08,227::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:20:08,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:20:08,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00107949 s, 3.8 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:20:09,842::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:09,863::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145841 s, 70.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:20:10,218::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:20:10,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000935731 s, 4.4 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:20:10,225::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:10,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) (47) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) (47) Queuing response >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) (48) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:10,226::__init__::232::IOProcess::(_processLogs) (48) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:11,236::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:11,238::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-166::DEBUG::2014-09-15 18:20:11,238::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:11,871::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:11,888::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119137 s, 86.0 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:12,418::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:12,419::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-167::DEBUG::2014-09-15 18:20:12,419::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-167::DEBUG::2014-09-15 18:20:12,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ec1d5b-85a7-491c-8449-3a080b089d09`::moving from state init -> state preparing >Thread-167::INFO::2014-09-15 18:20:12,420::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-167::INFO::2014-09-15 18:20:12,420::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-167::DEBUG::2014-09-15 18:20:12,420::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9ec1d5b-85a7-491c-8449-3a080b089d09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-167::DEBUG::2014-09-15 18:20:12,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9ec1d5b-85a7-491c-8449-3a080b089d09`::moving from state preparing -> state finished >Thread-167::DEBUG::2014-09-15 18:20:12,420::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-167::DEBUG::2014-09-15 18:20:12,420::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-167::DEBUG::2014-09-15 18:20:12,420::task::993::Storage.TaskManager.Task::(_decref) Task=`d9ec1d5b-85a7-491c-8449-3a080b089d09`::ref 0 aborting False >Thread-167::DEBUG::2014-09-15 18:20:12,421::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-167::DEBUG::2014-09-15 18:20:12,421::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:12,427::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-168::DEBUG::2014-09-15 18:20:12,428::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:12,428::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-168::DEBUG::2014-09-15 18:20:12,429::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebb53fbe-363b-4ec5-91a9-2d0b8d70355d`::moving from state init -> state preparing >Thread-168::INFO::2014-09-15 18:20:12,429::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-168::DEBUG::2014-09-15 18:20:12,429::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`106fe0c8-922b-44e9-82e0-6fd48854d0f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-168::DEBUG::2014-09-15 18:20:12,429::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-168::DEBUG::2014-09-15 18:20:12,430::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-168::DEBUG::2014-09-15 18:20:12,430::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`106fe0c8-922b-44e9-82e0-6fd48854d0f6`::Granted request >Thread-168::DEBUG::2014-09-15 18:20:12,430::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ebb53fbe-363b-4ec5-91a9-2d0b8d70355d`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-168::DEBUG::2014-09-15 18:20:12,430::task::993::Storage.TaskManager.Task::(_decref) Task=`ebb53fbe-363b-4ec5-91a9-2d0b8d70355d`::ref 1 aborting False >Thread-168::INFO::2014-09-15 18:20:12,430::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-168::DEBUG::2014-09-15 18:20:12,430::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebb53fbe-363b-4ec5-91a9-2d0b8d70355d`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-168::DEBUG::2014-09-15 18:20:12,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebb53fbe-363b-4ec5-91a9-2d0b8d70355d`::moving from state preparing -> state finished >Thread-168::DEBUG::2014-09-15 18:20:12,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-168::DEBUG::2014-09-15 18:20:12,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-168::DEBUG::2014-09-15 18:20:12,431::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-168::DEBUG::2014-09-15 18:20:12,431::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-168::DEBUG::2014-09-15 18:20:12,431::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-168::DEBUG::2014-09-15 18:20:12,431::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-168::DEBUG::2014-09-15 18:20:12,431::task::993::Storage.TaskManager.Task::(_decref) Task=`ebb53fbe-363b-4ec5-91a9-2d0b8d70355d`::ref 0 aborting False >Thread-168::DEBUG::2014-09-15 18:20:12,431::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-168::DEBUG::2014-09-15 18:20:12,431::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:13,896::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:13,912::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0117138 s, 87.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:14,246::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:14,246::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-169::DEBUG::2014-09-15 18:20:14,247::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:15,920::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:15,940::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158689 s, 64.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:17,257::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:17,258::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-170::DEBUG::2014-09-15 18:20:17,258::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:17,948::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:17,965::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124479 s, 82.3 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:20:18,832::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:20:18,838::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000925396 s, 4.4 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:20:19,973::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:19,993::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150794 s, 67.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:20:20,227::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:20:20,233::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000933013 s, 4.4 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:20:20,234::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:20,234::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:20,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:20,235::__init__::232::IOProcess::(_processLogs) (49) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:20,235::__init__::232::IOProcess::(_processLogs) (49) Queuing response >Thread-59::DEBUG::2014-09-15 18:20:20,235::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:20,235::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:20,235::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:20,236::__init__::232::IOProcess::(_processLogs) (50) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:20,236::__init__::232::IOProcess::(_processLogs) (50) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:20,265::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:20,266::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-171::DEBUG::2014-09-15 18:20:20,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`e34e5a0b-7ca8-4cb0-9738-b2f7bda9ad9d`::moving from state init -> state preparing >Thread-171::INFO::2014-09-15 18:20:20,267::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-171::INFO::2014-09-15 18:20:20,267::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000933013', 'lastCheck': '0.0', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000925396', 'lastCheck': '1.4', 'valid': True}} >Thread-171::DEBUG::2014-09-15 18:20:20,267::task::1191::Storage.TaskManager.Task::(prepare) Task=`e34e5a0b-7ca8-4cb0-9738-b2f7bda9ad9d`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000933013', 'lastCheck': '0.0', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000925396', 'lastCheck': '1.4', 'valid': True}} >Thread-171::DEBUG::2014-09-15 18:20:20,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`e34e5a0b-7ca8-4cb0-9738-b2f7bda9ad9d`::moving from state preparing -> state finished >Thread-171::DEBUG::2014-09-15 18:20:20,267::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-171::DEBUG::2014-09-15 18:20:20,267::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-171::DEBUG::2014-09-15 18:20:20,268::task::993::Storage.TaskManager.Task::(_decref) Task=`e34e5a0b-7ca8-4cb0-9738-b2f7bda9ad9d`::ref 0 aborting False >Thread-171::DEBUG::2014-09-15 18:20:20,269::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:20,277::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:20,277::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-172::DEBUG::2014-09-15 18:20:20,278::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:22,000::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:22,017::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116201 s, 88.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:22,498::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-173::DEBUG::2014-09-15 18:20:22,499::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:22,499::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-173::DEBUG::2014-09-15 18:20:22,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`ace4b69a-5b34-46a7-ad13-500c18b5faae`::moving from state init -> state preparing >Thread-173::INFO::2014-09-15 18:20:22,500::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-173::INFO::2014-09-15 18:20:22,500::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-173::DEBUG::2014-09-15 18:20:22,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`ace4b69a-5b34-46a7-ad13-500c18b5faae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-173::DEBUG::2014-09-15 18:20:22,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`ace4b69a-5b34-46a7-ad13-500c18b5faae`::moving from state preparing -> state finished >Thread-173::DEBUG::2014-09-15 18:20:22,501::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-173::DEBUG::2014-09-15 18:20:22,501::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-173::DEBUG::2014-09-15 18:20:22,501::task::993::Storage.TaskManager.Task::(_decref) Task=`ace4b69a-5b34-46a7-ad13-500c18b5faae`::ref 0 aborting False >Thread-173::DEBUG::2014-09-15 18:20:22,501::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-173::DEBUG::2014-09-15 18:20:22,501::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:22,505::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-174::DEBUG::2014-09-15 18:20:22,505::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:22,505::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-174::DEBUG::2014-09-15 18:20:22,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f61bbdd-49f7-4c28-97ca-ea4c5d1cc214`::moving from state init -> state preparing >Thread-174::INFO::2014-09-15 18:20:22,506::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-174::DEBUG::2014-09-15 18:20:22,507::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`eeffd7b0-e53f-4a16-8eb9-111cb8f0c32c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-174::DEBUG::2014-09-15 18:20:22,507::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-174::DEBUG::2014-09-15 18:20:22,507::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-174::DEBUG::2014-09-15 18:20:22,507::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`eeffd7b0-e53f-4a16-8eb9-111cb8f0c32c`::Granted request >Thread-174::DEBUG::2014-09-15 18:20:22,507::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5f61bbdd-49f7-4c28-97ca-ea4c5d1cc214`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-174::DEBUG::2014-09-15 18:20:22,508::task::993::Storage.TaskManager.Task::(_decref) Task=`5f61bbdd-49f7-4c28-97ca-ea4c5d1cc214`::ref 1 aborting False >Thread-174::INFO::2014-09-15 18:20:22,510::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-174::DEBUG::2014-09-15 18:20:22,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f61bbdd-49f7-4c28-97ca-ea4c5d1cc214`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-174::DEBUG::2014-09-15 18:20:22,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f61bbdd-49f7-4c28-97ca-ea4c5d1cc214`::moving from state preparing -> state finished >Thread-174::DEBUG::2014-09-15 18:20:22,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-174::DEBUG::2014-09-15 18:20:22,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-174::DEBUG::2014-09-15 18:20:22,511::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-174::DEBUG::2014-09-15 18:20:22,512::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-174::DEBUG::2014-09-15 18:20:22,512::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-174::DEBUG::2014-09-15 18:20:22,512::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-174::DEBUG::2014-09-15 18:20:22,512::task::993::Storage.TaskManager.Task::(_decref) Task=`5f61bbdd-49f7-4c28-97ca-ea4c5d1cc214`::ref 0 aborting False >Thread-174::DEBUG::2014-09-15 18:20:22,513::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-174::DEBUG::2014-09-15 18:20:22,513::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:23,354::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:23,355::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-175::DEBUG::2014-09-15 18:20:23,356::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:24,024::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:24,041::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123095 s, 83.2 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:20:26,049::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:26,073::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152281 s, 67.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:26,362::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:26,363::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-176::DEBUG::2014-09-15 18:20:26,363::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:28,081::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:28,104::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185335 s, 55.3 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:20:28,840::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:20:28,845::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000899394 s, 4.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:29,372::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:29,373::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-177::DEBUG::2014-09-15 18:20:29,374::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:30,112::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:30,129::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118354 s, 86.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:20:30,236::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:20:30,242::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100738 s, 4.1 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:20:30,243::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:30,243::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:30,244::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:30,244::__init__::232::IOProcess::(_processLogs) (51) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:30,244::__init__::232::IOProcess::(_processLogs) (51) Queuing response >Thread-59::DEBUG::2014-09-15 18:20:30,244::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:30,244::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:30,245::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:30,245::__init__::232::IOProcess::(_processLogs) (52) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:30,245::__init__::232::IOProcess::(_processLogs) (52) Queuing response >Dummy-65::DEBUG::2014-09-15 18:20:32,136::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:32,158::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016365 s, 62.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:32,385::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:32,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-178::DEBUG::2014-09-15 18:20:32,387::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:32,548::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:32,548::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-179::DEBUG::2014-09-15 18:20:32,548::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-179::DEBUG::2014-09-15 18:20:32,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`81b1a546-71e1-4a8e-9850-cb3b86ce8ddd`::moving from state init -> state preparing >Thread-179::INFO::2014-09-15 18:20:32,549::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-179::INFO::2014-09-15 18:20:32,550::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-179::DEBUG::2014-09-15 18:20:32,550::task::1191::Storage.TaskManager.Task::(prepare) Task=`81b1a546-71e1-4a8e-9850-cb3b86ce8ddd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-179::DEBUG::2014-09-15 18:20:32,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`81b1a546-71e1-4a8e-9850-cb3b86ce8ddd`::moving from state preparing -> state finished >Thread-179::DEBUG::2014-09-15 18:20:32,550::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-179::DEBUG::2014-09-15 18:20:32,550::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-179::DEBUG::2014-09-15 18:20:32,550::task::993::Storage.TaskManager.Task::(_decref) Task=`81b1a546-71e1-4a8e-9850-cb3b86ce8ddd`::ref 0 aborting False >Thread-179::DEBUG::2014-09-15 18:20:32,550::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-179::DEBUG::2014-09-15 18:20:32,550::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:32,556::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-180::DEBUG::2014-09-15 18:20:32,557::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:32,557::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-180::DEBUG::2014-09-15 18:20:32,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc9ccc43-113e-43bb-adcc-dceb3cf0df64`::moving from state init -> state preparing >Thread-180::INFO::2014-09-15 18:20:32,558::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-180::DEBUG::2014-09-15 18:20:32,558::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`7005b50c-2937-4526-8ac5-858b1a70379e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-180::DEBUG::2014-09-15 18:20:32,558::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-180::DEBUG::2014-09-15 18:20:32,559::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-180::DEBUG::2014-09-15 18:20:32,559::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`7005b50c-2937-4526-8ac5-858b1a70379e`::Granted request >Thread-180::DEBUG::2014-09-15 18:20:32,559::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cc9ccc43-113e-43bb-adcc-dceb3cf0df64`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-180::DEBUG::2014-09-15 18:20:32,559::task::993::Storage.TaskManager.Task::(_decref) Task=`cc9ccc43-113e-43bb-adcc-dceb3cf0df64`::ref 1 aborting False >Thread-180::INFO::2014-09-15 18:20:32,559::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-180::DEBUG::2014-09-15 18:20:32,559::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc9ccc43-113e-43bb-adcc-dceb3cf0df64`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-180::DEBUG::2014-09-15 18:20:32,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc9ccc43-113e-43bb-adcc-dceb3cf0df64`::moving from state preparing -> state finished >Thread-180::DEBUG::2014-09-15 18:20:32,559::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-180::DEBUG::2014-09-15 18:20:32,560::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-180::DEBUG::2014-09-15 18:20:32,560::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-180::DEBUG::2014-09-15 18:20:32,560::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-180::DEBUG::2014-09-15 18:20:32,560::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-180::DEBUG::2014-09-15 18:20:32,560::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-180::DEBUG::2014-09-15 18:20:32,560::task::993::Storage.TaskManager.Task::(_decref) Task=`cc9ccc43-113e-43bb-adcc-dceb3cf0df64`::ref 0 aborting False >Thread-180::DEBUG::2014-09-15 18:20:32,560::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-180::DEBUG::2014-09-15 18:20:32,560::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:34,165::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:34,189::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188687 s, 54.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:35,398::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:35,399::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-181::DEBUG::2014-09-15 18:20:35,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b390253-050a-4baf-a057-5050866ef140`::moving from state init -> state preparing >Thread-181::INFO::2014-09-15 18:20:35,400::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-181::INFO::2014-09-15 18:20:35,400::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100738', 'lastCheck': '5.2', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899394', 'lastCheck': '6.6', 'valid': True}} >Thread-181::DEBUG::2014-09-15 18:20:35,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b390253-050a-4baf-a057-5050866ef140`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100738', 'lastCheck': '5.2', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899394', 'lastCheck': '6.6', 'valid': True}} >Thread-181::DEBUG::2014-09-15 18:20:35,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b390253-050a-4baf-a057-5050866ef140`::moving from state preparing -> state finished >Thread-181::DEBUG::2014-09-15 18:20:35,401::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-181::DEBUG::2014-09-15 18:20:35,401::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-181::DEBUG::2014-09-15 18:20:35,401::task::993::Storage.TaskManager.Task::(_decref) Task=`2b390253-050a-4baf-a057-5050866ef140`::ref 0 aborting False >Thread-181::DEBUG::2014-09-15 18:20:35,402::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:35,416::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:35,417::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-182::DEBUG::2014-09-15 18:20:35,418::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:36,196::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:36,220::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0195325 s, 52.4 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:20:38,228::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:38,249::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155328 s, 65.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:38,514::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:38,515::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-183::DEBUG::2014-09-15 18:20:38,516::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:20:38,846::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:20:38,851::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000735618 s, 5.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:20:40,245::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:20:40,250::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781285 s, 5.2 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:20:40,252::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:40,252::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:40,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:40,253::__init__::232::IOProcess::(_processLogs) (53) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:40,253::__init__::232::IOProcess::(_processLogs) (53) Queuing response >Thread-59::DEBUG::2014-09-15 18:20:40,253::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:40,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:40,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:40,254::__init__::232::IOProcess::(_processLogs) (54) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:40,254::__init__::232::IOProcess::(_processLogs) (54) Queuing response >Dummy-65::DEBUG::2014-09-15 18:20:40,256::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:40,273::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122599 s, 83.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:41,521::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:41,522::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-184::DEBUG::2014-09-15 18:20:41,523::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:42,280::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:42,302::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163923 s, 62.5 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:42,602::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-185::DEBUG::2014-09-15 18:20:42,602::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:42,603::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-185::DEBUG::2014-09-15 18:20:42,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cdc5d85-2403-4d66-8f72-c85d3824cd8b`::moving from state init -> state preparing >Thread-185::INFO::2014-09-15 18:20:42,604::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-185::INFO::2014-09-15 18:20:42,604::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-185::DEBUG::2014-09-15 18:20:42,604::task::1191::Storage.TaskManager.Task::(prepare) Task=`5cdc5d85-2403-4d66-8f72-c85d3824cd8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-185::DEBUG::2014-09-15 18:20:42,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`5cdc5d85-2403-4d66-8f72-c85d3824cd8b`::moving from state preparing -> state finished >Thread-185::DEBUG::2014-09-15 18:20:42,604::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-185::DEBUG::2014-09-15 18:20:42,604::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-185::DEBUG::2014-09-15 18:20:42,604::task::993::Storage.TaskManager.Task::(_decref) Task=`5cdc5d85-2403-4d66-8f72-c85d3824cd8b`::ref 0 aborting False >Thread-185::DEBUG::2014-09-15 18:20:42,604::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-185::DEBUG::2014-09-15 18:20:42,604::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:42,608::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-186::DEBUG::2014-09-15 18:20:42,609::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:20:42,609::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-186::DEBUG::2014-09-15 18:20:42,609::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d2332f0-28ae-44b3-86f6-9774a4865bf5`::moving from state init -> state preparing >Thread-186::INFO::2014-09-15 18:20:42,610::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-186::DEBUG::2014-09-15 18:20:42,610::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ca9e40d6-6571-4950-8b8c-16b2a2b6883e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-186::DEBUG::2014-09-15 18:20:42,610::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-186::DEBUG::2014-09-15 18:20:42,610::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-186::DEBUG::2014-09-15 18:20:42,610::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ca9e40d6-6571-4950-8b8c-16b2a2b6883e`::Granted request >Thread-186::DEBUG::2014-09-15 18:20:42,610::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0d2332f0-28ae-44b3-86f6-9774a4865bf5`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-186::DEBUG::2014-09-15 18:20:42,610::task::993::Storage.TaskManager.Task::(_decref) Task=`0d2332f0-28ae-44b3-86f6-9774a4865bf5`::ref 1 aborting False >Thread-186::INFO::2014-09-15 18:20:42,611::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-186::DEBUG::2014-09-15 18:20:42,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d2332f0-28ae-44b3-86f6-9774a4865bf5`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-186::DEBUG::2014-09-15 18:20:42,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d2332f0-28ae-44b3-86f6-9774a4865bf5`::moving from state preparing -> state finished >Thread-186::DEBUG::2014-09-15 18:20:42,611::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-186::DEBUG::2014-09-15 18:20:42,611::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-186::DEBUG::2014-09-15 18:20:42,611::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-186::DEBUG::2014-09-15 18:20:42,611::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-186::DEBUG::2014-09-15 18:20:42,611::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-186::DEBUG::2014-09-15 18:20:42,611::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-186::DEBUG::2014-09-15 18:20:42,612::task::993::Storage.TaskManager.Task::(_decref) Task=`0d2332f0-28ae-44b3-86f6-9774a4865bf5`::ref 0 aborting False >Thread-186::DEBUG::2014-09-15 18:20:42,612::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-186::DEBUG::2014-09-15 18:20:42,612::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:44,309::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:44,330::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163003 s, 62.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:44,529::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:44,530::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-187::DEBUG::2014-09-15 18:20:44,531::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:46,337::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:46,355::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127516 s, 80.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:47,539::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:47,540::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-188::DEBUG::2014-09-15 18:20:47,540::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:48,363::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:48,382::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0149628 s, 68.4 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:20:48,853::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:20:48,858::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000845822 s, 4.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:20:50,254::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:20:50,259::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000724128 s, 5.7 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:20:50,261::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:50,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:50,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:50,261::__init__::232::IOProcess::(_processLogs) (55) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:50,261::__init__::232::IOProcess::(_processLogs) (55) Queuing response >Thread-59::DEBUG::2014-09-15 18:20:50,262::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:20:50,262::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:20:50,262::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:20:50,262::__init__::232::IOProcess::(_processLogs) (56) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:20:50,263::__init__::232::IOProcess::(_processLogs) (56) Queuing response >Dummy-65::DEBUG::2014-09-15 18:20:50,390::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:50,406::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120377 s, 85.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:50,550::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:50,552::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-189::DEBUG::2014-09-15 18:20:50,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`92ea0adf-d6ed-42a0-b52f-b532ad89f880`::moving from state init -> state preparing >Thread-189::INFO::2014-09-15 18:20:50,555::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-189::INFO::2014-09-15 18:20:50,556::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724128', 'lastCheck': '0.3', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845822', 'lastCheck': '1.7', 'valid': True}} >Thread-189::DEBUG::2014-09-15 18:20:50,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`92ea0adf-d6ed-42a0-b52f-b532ad89f880`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000724128', 'lastCheck': '0.3', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845822', 'lastCheck': '1.7', 'valid': True}} >Thread-189::DEBUG::2014-09-15 18:20:50,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`92ea0adf-d6ed-42a0-b52f-b532ad89f880`::moving from state preparing -> state finished >Thread-189::DEBUG::2014-09-15 18:20:50,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-189::DEBUG::2014-09-15 18:20:50,557::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-189::DEBUG::2014-09-15 18:20:50,557::task::993::Storage.TaskManager.Task::(_decref) Task=`92ea0adf-d6ed-42a0-b52f-b532ad89f880`::ref 0 aborting False >Thread-189::DEBUG::2014-09-15 18:20:50,558::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:50,578::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:50,579::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-190::DEBUG::2014-09-15 18:20:50,580::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:52,413::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:52,435::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174872 s, 58.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:52,673::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:52,673::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-191::DEBUG::2014-09-15 18:20:52,673::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-191::DEBUG::2014-09-15 18:20:52,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`72cdea6d-9231-4e2d-b858-a9cc5a713fca`::moving from state init -> state preparing >Thread-191::INFO::2014-09-15 18:20:52,674::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-191::INFO::2014-09-15 18:20:52,674::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-191::DEBUG::2014-09-15 18:20:52,675::task::1191::Storage.TaskManager.Task::(prepare) Task=`72cdea6d-9231-4e2d-b858-a9cc5a713fca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-191::DEBUG::2014-09-15 18:20:52,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`72cdea6d-9231-4e2d-b858-a9cc5a713fca`::moving from state preparing -> state finished >Thread-191::DEBUG::2014-09-15 18:20:52,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-191::DEBUG::2014-09-15 18:20:52,675::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-191::DEBUG::2014-09-15 18:20:52,675::task::993::Storage.TaskManager.Task::(_decref) Task=`72cdea6d-9231-4e2d-b858-a9cc5a713fca`::ref 0 aborting False >Thread-191::DEBUG::2014-09-15 18:20:52,675::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-191::DEBUG::2014-09-15 18:20:52,675::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:52,679::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:52,680::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-192::DEBUG::2014-09-15 18:20:52,680::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-192::DEBUG::2014-09-15 18:20:52,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`df0faf9c-2571-4b52-a897-a1006b268752`::moving from state init -> state preparing >Thread-192::INFO::2014-09-15 18:20:52,681::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-192::DEBUG::2014-09-15 18:20:52,681::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`99aaa7dd-e2c5-4427-b10e-2400ec6ac0c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-192::DEBUG::2014-09-15 18:20:52,681::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-192::DEBUG::2014-09-15 18:20:52,681::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-192::DEBUG::2014-09-15 18:20:52,681::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`99aaa7dd-e2c5-4427-b10e-2400ec6ac0c4`::Granted request >Thread-192::DEBUG::2014-09-15 18:20:52,681::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`df0faf9c-2571-4b52-a897-a1006b268752`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-192::DEBUG::2014-09-15 18:20:52,681::task::993::Storage.TaskManager.Task::(_decref) Task=`df0faf9c-2571-4b52-a897-a1006b268752`::ref 1 aborting False >Thread-192::INFO::2014-09-15 18:20:52,682::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-192::DEBUG::2014-09-15 18:20:52,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`df0faf9c-2571-4b52-a897-a1006b268752`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-192::DEBUG::2014-09-15 18:20:52,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`df0faf9c-2571-4b52-a897-a1006b268752`::moving from state preparing -> state finished >Thread-192::DEBUG::2014-09-15 18:20:52,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-192::DEBUG::2014-09-15 18:20:52,682::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2014-09-15 18:20:52,682::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-192::DEBUG::2014-09-15 18:20:52,682::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-192::DEBUG::2014-09-15 18:20:52,682::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-192::DEBUG::2014-09-15 18:20:52,682::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-192::DEBUG::2014-09-15 18:20:52,683::task::993::Storage.TaskManager.Task::(_decref) Task=`df0faf9c-2571-4b52-a897-a1006b268752`::ref 0 aborting False >Thread-192::DEBUG::2014-09-15 18:20:52,683::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-192::DEBUG::2014-09-15 18:20:52,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:53,681::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:53,682::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-193::DEBUG::2014-09-15 18:20:53,683::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:54,443::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:54,460::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125159 s, 81.8 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:20:56,468::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:56,492::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148863 s, 68.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:56,691::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:56,692::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-194::DEBUG::2014-09-15 18:20:56,692::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:20:58,500::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:20:58,519::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0151261 s, 67.7 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:20:58,860::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:20:58,865::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000849845 s, 4.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:20:59,700::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:20:59,701::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-195::DEBUG::2014-09-15 18:20:59,702::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-15 18:21:00,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:21:00,268::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000807447 s, 5.1 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:21:00,270::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:00,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:00,270::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:00,270::__init__::232::IOProcess::(_processLogs) (57) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:00,270::__init__::232::IOProcess::(_processLogs) (57) Queuing response >Thread-59::DEBUG::2014-09-15 18:21:00,270::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:00,271::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:00,271::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:00,271::__init__::232::IOProcess::(_processLogs) (58) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:00,271::__init__::232::IOProcess::(_processLogs) (58) Queuing response >Dummy-65::DEBUG::2014-09-15 18:21:00,527::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:00,544::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119651 s, 85.6 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:21:02,552::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:02,574::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155757 s, 65.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:02,702::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:02,703::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-196::DEBUG::2014-09-15 18:21:02,703::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >Thread-196::DEBUG::2014-09-15 18:21:02,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd263f58-2eb5-4e98-9000-2454bd82112d`::moving from state init -> state preparing >Thread-196::INFO::2014-09-15 18:21:02,704::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-196::INFO::2014-09-15 18:21:02,704::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-196::DEBUG::2014-09-15 18:21:02,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd263f58-2eb5-4e98-9000-2454bd82112d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-196::DEBUG::2014-09-15 18:21:02,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd263f58-2eb5-4e98-9000-2454bd82112d`::moving from state preparing -> state finished >Thread-196::DEBUG::2014-09-15 18:21:02,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-196::DEBUG::2014-09-15 18:21:02,704::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-196::DEBUG::2014-09-15 18:21:02,705::task::993::Storage.TaskManager.Task::(_decref) Task=`fd263f58-2eb5-4e98-9000-2454bd82112d`::ref 0 aborting False >Thread-196::DEBUG::2014-09-15 18:21:02,705::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-196::DEBUG::2014-09-15 18:21:02,705::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:02,711::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:02,712::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:02,712::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-198::DEBUG::2014-09-15 18:21:02,713::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:02,713::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-197::DEBUG::2014-09-15 18:21:02,715::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-198::DEBUG::2014-09-15 18:21:02,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`0718d424-a8b7-4775-9a80-31dfc92f8ac0`::moving from state init -> state preparing >Thread-198::INFO::2014-09-15 18:21:02,716::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-198::DEBUG::2014-09-15 18:21:02,716::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ed8855cf-f043-496a-8fe7-31d10adb572e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-198::DEBUG::2014-09-15 18:21:02,716::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-198::DEBUG::2014-09-15 18:21:02,717::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-198::DEBUG::2014-09-15 18:21:02,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ed8855cf-f043-496a-8fe7-31d10adb572e`::Granted request >Thread-198::DEBUG::2014-09-15 18:21:02,717::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0718d424-a8b7-4775-9a80-31dfc92f8ac0`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-198::DEBUG::2014-09-15 18:21:02,717::task::993::Storage.TaskManager.Task::(_decref) Task=`0718d424-a8b7-4775-9a80-31dfc92f8ac0`::ref 1 aborting False >Thread-198::INFO::2014-09-15 18:21:02,717::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-198::DEBUG::2014-09-15 18:21:02,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`0718d424-a8b7-4775-9a80-31dfc92f8ac0`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-198::DEBUG::2014-09-15 18:21:02,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`0718d424-a8b7-4775-9a80-31dfc92f8ac0`::moving from state preparing -> state finished >Thread-198::DEBUG::2014-09-15 18:21:02,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-198::DEBUG::2014-09-15 18:21:02,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-198::DEBUG::2014-09-15 18:21:02,718::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-198::DEBUG::2014-09-15 18:21:02,718::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-198::DEBUG::2014-09-15 18:21:02,718::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-198::DEBUG::2014-09-15 18:21:02,718::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-198::DEBUG::2014-09-15 18:21:02,718::task::993::Storage.TaskManager.Task::(_decref) Task=`0718d424-a8b7-4775-9a80-31dfc92f8ac0`::ref 0 aborting False >Thread-198::DEBUG::2014-09-15 18:21:02,718::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-198::DEBUG::2014-09-15 18:21:02,719::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:04,583::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:04,603::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160725 s, 63.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:05,723::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:05,724::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-199::DEBUG::2014-09-15 18:21:05,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`bac83b7c-2108-48ea-a3d7-507c4dae4dea`::moving from state init -> state preparing >Thread-199::INFO::2014-09-15 18:21:05,725::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-199::INFO::2014-09-15 18:21:05,725::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807447', 'lastCheck': '5.5', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000849845', 'lastCheck': '6.9', 'valid': True}} >Thread-199::DEBUG::2014-09-15 18:21:05,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`bac83b7c-2108-48ea-a3d7-507c4dae4dea`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807447', 'lastCheck': '5.5', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000849845', 'lastCheck': '6.9', 'valid': True}} >Thread-199::DEBUG::2014-09-15 18:21:05,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`bac83b7c-2108-48ea-a3d7-507c4dae4dea`::moving from state preparing -> state finished >Thread-199::DEBUG::2014-09-15 18:21:05,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-199::DEBUG::2014-09-15 18:21:05,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-199::DEBUG::2014-09-15 18:21:05,726::task::993::Storage.TaskManager.Task::(_decref) Task=`bac83b7c-2108-48ea-a3d7-507c4dae4dea`::ref 0 aborting False >Thread-199::DEBUG::2014-09-15 18:21:05,727::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:05,750::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:05,751::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-200::DEBUG::2014-09-15 18:21:05,752::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:06,611::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:06,628::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121532 s, 84.3 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:21:08,635::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:08,653::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125861 s, 81.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:08,838::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:08,839::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-201::DEBUG::2014-09-15 18:21:08,840::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:21:08,866::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:21:08,872::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00093898 s, 4.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:21:10,272::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:21:10,277::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000965064 s, 4.2 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:21:10,278::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:10,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:10,279::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:10,279::__init__::232::IOProcess::(_processLogs) (59) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:10,279::__init__::232::IOProcess::(_processLogs) (59) Queuing response >Thread-59::DEBUG::2014-09-15 18:21:10,279::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:10,279::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:10,280::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:10,280::__init__::232::IOProcess::(_processLogs) (60) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:10,280::__init__::232::IOProcess::(_processLogs) (60) Queuing response >Dummy-65::DEBUG::2014-09-15 18:21:10,660::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:10,679::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135723 s, 75.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:11,853::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:11,854::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-202::DEBUG::2014-09-15 18:21:11,855::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:12,686::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:12,704::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129063 s, 79.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:12,834::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-203::DEBUG::2014-09-15 18:21:12,835::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:12,835::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-203::DEBUG::2014-09-15 18:21:12,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d678a57-c2f1-4f92-b2df-7f2f001f49e1`::moving from state init -> state preparing >Thread-203::INFO::2014-09-15 18:21:12,836::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-203::INFO::2014-09-15 18:21:12,836::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-203::DEBUG::2014-09-15 18:21:12,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d678a57-c2f1-4f92-b2df-7f2f001f49e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-203::DEBUG::2014-09-15 18:21:12,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d678a57-c2f1-4f92-b2df-7f2f001f49e1`::moving from state preparing -> state finished >Thread-203::DEBUG::2014-09-15 18:21:12,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-203::DEBUG::2014-09-15 18:21:12,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-203::DEBUG::2014-09-15 18:21:12,837::task::993::Storage.TaskManager.Task::(_decref) Task=`5d678a57-c2f1-4f92-b2df-7f2f001f49e1`::ref 0 aborting False >Thread-203::DEBUG::2014-09-15 18:21:12,837::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-203::DEBUG::2014-09-15 18:21:12,837::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:12,844::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-204::DEBUG::2014-09-15 18:21:12,845::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:12,845::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-204::DEBUG::2014-09-15 18:21:12,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce389211-805a-4467-bf8c-ffeeae4f8226`::moving from state init -> state preparing >Thread-204::INFO::2014-09-15 18:21:12,846::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-204::DEBUG::2014-09-15 18:21:12,846::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`55fb978d-9b83-48c3-97ef-9c89270d4952`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-204::DEBUG::2014-09-15 18:21:12,846::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-204::DEBUG::2014-09-15 18:21:12,846::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-204::DEBUG::2014-09-15 18:21:12,847::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`55fb978d-9b83-48c3-97ef-9c89270d4952`::Granted request >Thread-204::DEBUG::2014-09-15 18:21:12,847::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce389211-805a-4467-bf8c-ffeeae4f8226`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-204::DEBUG::2014-09-15 18:21:12,847::task::993::Storage.TaskManager.Task::(_decref) Task=`ce389211-805a-4467-bf8c-ffeeae4f8226`::ref 1 aborting False >Thread-204::INFO::2014-09-15 18:21:12,847::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-204::DEBUG::2014-09-15 18:21:12,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce389211-805a-4467-bf8c-ffeeae4f8226`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-204::DEBUG::2014-09-15 18:21:12,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce389211-805a-4467-bf8c-ffeeae4f8226`::moving from state preparing -> state finished >Thread-204::DEBUG::2014-09-15 18:21:12,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-204::DEBUG::2014-09-15 18:21:12,848::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2014-09-15 18:21:12,848::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-204::DEBUG::2014-09-15 18:21:12,848::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-204::DEBUG::2014-09-15 18:21:12,848::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-204::DEBUG::2014-09-15 18:21:12,848::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-204::DEBUG::2014-09-15 18:21:12,848::task::993::Storage.TaskManager.Task::(_decref) Task=`ce389211-805a-4467-bf8c-ffeeae4f8226`::ref 0 aborting False >Thread-204::DEBUG::2014-09-15 18:21:12,848::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-204::DEBUG::2014-09-15 18:21:12,848::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:14,712::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:14,730::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0140877 s, 72.7 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:14,863::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:14,864::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-205::DEBUG::2014-09-15 18:21:14,865::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:16,738::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:16,759::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016754 s, 61.1 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:17,871::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:17,872::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-206::DEBUG::2014-09-15 18:21:17,873::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:18,767::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:18,792::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.019639 s, 52.1 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:21:18,873::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:21:18,879::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000833874 s, 4.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:21:20,281::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:21:20,285::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000677007 s, 6.1 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:21:20,287::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:20,287::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:20,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:20,287::__init__::232::IOProcess::(_processLogs) (61) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:20,287::__init__::232::IOProcess::(_processLogs) (61) Queuing response >Thread-59::DEBUG::2014-09-15 18:21:20,288::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:20,288::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:20,288::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:20,289::__init__::232::IOProcess::(_processLogs) (62) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:20,289::__init__::232::IOProcess::(_processLogs) (62) Queuing response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:20,883::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:20,883::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-207::DEBUG::2014-09-15 18:21:20,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`03c22a21-e9dc-4f68-85f8-d5c149be7039`::moving from state init -> state preparing >Thread-207::INFO::2014-09-15 18:21:20,884::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-207::INFO::2014-09-15 18:21:20,885::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677007', 'lastCheck': '0.6', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833874', 'lastCheck': '2.0', 'valid': True}} >Thread-207::DEBUG::2014-09-15 18:21:20,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`03c22a21-e9dc-4f68-85f8-d5c149be7039`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677007', 'lastCheck': '0.6', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833874', 'lastCheck': '2.0', 'valid': True}} >Thread-207::DEBUG::2014-09-15 18:21:20,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`03c22a21-e9dc-4f68-85f8-d5c149be7039`::moving from state preparing -> state finished >Thread-207::DEBUG::2014-09-15 18:21:20,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-207::DEBUG::2014-09-15 18:21:20,885::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-207::DEBUG::2014-09-15 18:21:20,885::task::993::Storage.TaskManager.Task::(_decref) Task=`03c22a21-e9dc-4f68-85f8-d5c149be7039`::ref 0 aborting False >Thread-207::DEBUG::2014-09-15 18:21:20,886::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:20,896::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Dummy-65::DEBUG::2014-09-15 18:21:20,897::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpcServer::DEBUG::2014-09-15 18:21:20,897::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-208::DEBUG::2014-09-15 18:21:20,902::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:20,916::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138678 s, 73.8 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:22,897::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-209::DEBUG::2014-09-15 18:21:22,898::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:22,898::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-209::DEBUG::2014-09-15 18:21:22,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`95a5d18c-0195-4a9e-838e-c1a38591580e`::moving from state init -> state preparing >Thread-209::INFO::2014-09-15 18:21:22,899::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-209::INFO::2014-09-15 18:21:22,899::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-209::DEBUG::2014-09-15 18:21:22,899::task::1191::Storage.TaskManager.Task::(prepare) Task=`95a5d18c-0195-4a9e-838e-c1a38591580e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-209::DEBUG::2014-09-15 18:21:22,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`95a5d18c-0195-4a9e-838e-c1a38591580e`::moving from state preparing -> state finished >Thread-209::DEBUG::2014-09-15 18:21:22,899::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-209::DEBUG::2014-09-15 18:21:22,899::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-209::DEBUG::2014-09-15 18:21:22,899::task::993::Storage.TaskManager.Task::(_decref) Task=`95a5d18c-0195-4a9e-838e-c1a38591580e`::ref 0 aborting False >Thread-209::DEBUG::2014-09-15 18:21:22,899::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-209::DEBUG::2014-09-15 18:21:22,900::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:22,903::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-210::DEBUG::2014-09-15 18:21:22,904::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:22,904::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-210::DEBUG::2014-09-15 18:21:22,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`77b21c36-53d0-4a17-a5c9-a359022e1034`::moving from state init -> state preparing >Thread-210::INFO::2014-09-15 18:21:22,905::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-210::DEBUG::2014-09-15 18:21:22,905::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`2185a7fa-5831-4eda-8d8a-27d277dcf704`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-210::DEBUG::2014-09-15 18:21:22,905::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-210::DEBUG::2014-09-15 18:21:22,905::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-210::DEBUG::2014-09-15 18:21:22,905::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`2185a7fa-5831-4eda-8d8a-27d277dcf704`::Granted request >Thread-210::DEBUG::2014-09-15 18:21:22,905::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77b21c36-53d0-4a17-a5c9-a359022e1034`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-210::DEBUG::2014-09-15 18:21:22,905::task::993::Storage.TaskManager.Task::(_decref) Task=`77b21c36-53d0-4a17-a5c9-a359022e1034`::ref 1 aborting False >Thread-210::INFO::2014-09-15 18:21:22,906::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-210::DEBUG::2014-09-15 18:21:22,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`77b21c36-53d0-4a17-a5c9-a359022e1034`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-210::DEBUG::2014-09-15 18:21:22,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`77b21c36-53d0-4a17-a5c9-a359022e1034`::moving from state preparing -> state finished >Thread-210::DEBUG::2014-09-15 18:21:22,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-210::DEBUG::2014-09-15 18:21:22,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-210::DEBUG::2014-09-15 18:21:22,906::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-210::DEBUG::2014-09-15 18:21:22,906::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-210::DEBUG::2014-09-15 18:21:22,906::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-210::DEBUG::2014-09-15 18:21:22,906::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-210::DEBUG::2014-09-15 18:21:22,906::task::993::Storage.TaskManager.Task::(_decref) Task=`77b21c36-53d0-4a17-a5c9-a359022e1034`::ref 0 aborting False >Thread-210::DEBUG::2014-09-15 18:21:22,907::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-210::DEBUG::2014-09-15 18:21:22,907::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:22,924::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:22,940::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120666 s, 84.9 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:23,997::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:23,998::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-211::DEBUG::2014-09-15 18:21:23,998::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:24,948::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:24,968::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158377 s, 64.7 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:21:26,975::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:26,996::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016711 s, 61.3 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:27,011::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:27,012::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-212::DEBUG::2014-09-15 18:21:27,013::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-20::DEBUG::2014-09-15 18:21:28,881::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:21:28,888::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000815356 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:21:29,004::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:29,020::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0118251 s, 86.6 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:30,023::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:30,024::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-213::DEBUG::2014-09-15 18:21:30,025::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-19::DEBUG::2014-09-15 18:21:30,289::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:21:30,294::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000769392 s, 5.3 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:21:30,296::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:30,296::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:30,296::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:30,296::__init__::232::IOProcess::(_processLogs) (63) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:30,296::__init__::232::IOProcess::(_processLogs) (63) Queuing response >Thread-59::DEBUG::2014-09-15 18:21:30,296::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:30,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:30,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:30,297::__init__::232::IOProcess::(_processLogs) (64) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:30,297::__init__::232::IOProcess::(_processLogs) (64) Queuing response >Dummy-65::DEBUG::2014-09-15 18:21:31,028::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:31,047::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145786 s, 70.2 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:32,938::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-214::DEBUG::2014-09-15 18:21:32,939::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getSpmStatus' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:32,939::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-214::DEBUG::2014-09-15 18:21:32,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9bdb777-80be-4a88-90f3-7b172a5ec955`::moving from state init -> state preparing >Thread-214::INFO::2014-09-15 18:21:32,940::logUtils::48::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-214::INFO::2014-09-15 18:21:32,940::logUtils::51::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-214::DEBUG::2014-09-15 18:21:32,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9bdb777-80be-4a88-90f3-7b172a5ec955`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1}} >Thread-214::DEBUG::2014-09-15 18:21:32,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9bdb777-80be-4a88-90f3-7b172a5ec955`::moving from state preparing -> state finished >Thread-214::DEBUG::2014-09-15 18:21:32,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-214::DEBUG::2014-09-15 18:21:32,941::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-214::DEBUG::2014-09-15 18:21:32,941::task::993::Storage.TaskManager.Task::(_decref) Task=`f9bdb777-80be-4a88-90f3-7b172a5ec955`::ref 0 aborting False >Thread-214::DEBUG::2014-09-15 18:21:32,941::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getSpmStatus' in bridge with {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 1} >Thread-214::DEBUG::2014-09-15 18:21:32,941::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:32,949::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-215::DEBUG::2014-09-15 18:21:32,949::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'StoragePool.getInfo' in bridge with {u'storagepoolID': u'b86b687a-d073-497a-ac8a-249025419a3e'} >JsonRpcServer::DEBUG::2014-09-15 18:21:32,949::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-215::DEBUG::2014-09-15 18:21:32,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`85a90fbb-d610-42bb-b694-c81989106a87`::moving from state init -> state preparing >Thread-215::INFO::2014-09-15 18:21:32,950::logUtils::48::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID=u'b86b687a-d073-497a-ac8a-249025419a3e', options=None) >Thread-215::DEBUG::2014-09-15 18:21:32,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`51ab294c-bb78-4465-90b0-8b28613ea0fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2635' at 'getStoragePoolInfo' >Thread-215::DEBUG::2014-09-15 18:21:32,951::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'shared' >Thread-215::DEBUG::2014-09-15 18:21:32,951::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'shared' (1 active user) >Thread-215::DEBUG::2014-09-15 18:21:32,951::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`51ab294c-bb78-4465-90b0-8b28613ea0fc`::Granted request >Thread-215::DEBUG::2014-09-15 18:21:32,951::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`85a90fbb-d610-42bb-b694-c81989106a87`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (shared) >Thread-215::DEBUG::2014-09-15 18:21:32,951::task::993::Storage.TaskManager.Task::(_decref) Task=`85a90fbb-d610-42bb-b694-c81989106a87`::ref 1 aborting False >Thread-215::INFO::2014-09-15 18:21:32,951::logUtils::51::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-215::DEBUG::2014-09-15 18:21:32,952::task::1191::Storage.TaskManager.Task::(prepare) Task=`85a90fbb-d610-42bb-b694-c81989106a87`::finished: {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-215::DEBUG::2014-09-15 18:21:32,952::task::595::Storage.TaskManager.Task::(_updateState) Task=`85a90fbb-d610-42bb-b694-c81989106a87`::moving from state preparing -> state finished >Thread-215::DEBUG::2014-09-15 18:21:32,952::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {u'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>} >Thread-215::DEBUG::2014-09-15 18:21:32,952::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-215::DEBUG::2014-09-15 18:21:32,952::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' >Thread-215::DEBUG::2014-09-15 18:21:32,952::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users) >Thread-215::DEBUG::2014-09-15 18:21:32,952::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it. >Thread-215::DEBUG::2014-09-15 18:21:32,952::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records. >Thread-215::DEBUG::2014-09-15 18:21:32,952::task::993::Storage.TaskManager.Task::(_decref) Task=`85a90fbb-d610-42bb-b694-c81989106a87`::ref 0 aborting False >Thread-215::DEBUG::2014-09-15 18:21:32,952::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'StoragePool.getInfo' in bridge with {'info': {'name': 'iscsi-el7', 'isoprefix': '', 'pool_status': 'connected', 'lver': 1, 'domains': u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1:Active,aa740243-00c8-498a-a94a-f8330738e5b9:Active', 'master_uuid': 'b9c2b835-cdbd-48ea-8d69-7a33042c79b1', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'status': u'Active', 'diskfree': '16911433728', 'isoprefix': '', 'alerts': [], 'disktotal': '21072183296', 'version': 3}}} >Thread-215::DEBUG::2014-09-15 18:21:32,952::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:33,036::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:33,037::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-216::DEBUG::2014-09-15 18:21:33,037::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:33,055::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:33,072::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122506 s, 83.6 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:21:35,080::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:35,101::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0164099 s, 62.4 MB/s\n'; <rc> = 0 >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:36,048::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:36,049::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-217::DEBUG::2014-09-15 18:21:36,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8935048-c9e6-4767-8b76-c7bf11ae45f1`::moving from state init -> state preparing >Thread-217::INFO::2014-09-15 18:21:36,050::logUtils::48::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-217::INFO::2014-09-15 18:21:36,050::logUtils::51::dispatcher::(wrapper) Run and protect: repoStats, Return response: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769392', 'lastCheck': '5.8', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000815356', 'lastCheck': '7.2', 'valid': True}} >Thread-217::DEBUG::2014-09-15 18:21:36,050::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8935048-c9e6-4767-8b76-c7bf11ae45f1`::finished: {u'b9c2b835-cdbd-48ea-8d69-7a33042c79b1': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769392', 'lastCheck': '5.8', 'valid': True}, u'aa740243-00c8-498a-a94a-f8330738e5b9': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000815356', 'lastCheck': '7.2', 'valid': True}} >Thread-217::DEBUG::2014-09-15 18:21:36,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8935048-c9e6-4767-8b76-c7bf11ae45f1`::moving from state preparing -> state finished >Thread-217::DEBUG::2014-09-15 18:21:36,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-217::DEBUG::2014-09-15 18:21:36,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-217::DEBUG::2014-09-15 18:21:36,051::task::993::Storage.TaskManager.Task::(_decref) Task=`b8935048-c9e6-4767-8b76-c7bf11ae45f1`::ref 0 aborting False >Thread-217::DEBUG::2014-09-15 18:21:36,052::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:36,064::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:36,065::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-218::DEBUG::2014-09-15 18:21:36,066::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:37,108::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:37,129::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0157987 s, 64.8 MB/s\n'; <rc> = 0 >Thread-20::DEBUG::2014-09-15 18:21:38,890::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/aa740243-00c8-498a-a94a-f8330738e5b9/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-20::DEBUG::2014-09-15 18:21:38,895::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105925 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-65::DEBUG::2014-09-15 18:21:39,137::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >JsonRpc (StompReactor)::DEBUG::2014-09-15 18:21:39,146::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-09-15 18:21:39,147::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-219::DEBUG::2014-09-15 18:21:39,148::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Dummy-65::DEBUG::2014-09-15 18:21:39,153::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0116484 s, 87.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-09-15 18:21:40,298::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/dev/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-09-15 18:21:40,303::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000887517 s, 4.6 MB/s\n'; <rc> = 0 >Thread-59::DEBUG::2014-09-15 18:21:40,304::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:40,305::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:40,305::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:40,305::__init__::232::IOProcess::(_processLogs) (65) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:40,305::__init__::232::IOProcess::(_processLogs) (65) Queuing response >Thread-59::DEBUG::2014-09-15 18:21:40,305::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-59::DEBUG::2014-09-15 18:21:40,306::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-59::DEBUG::2014-09-15 18:21:40,306::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-59::DEBUG::2014-09-15 18:21:40,306::__init__::232::IOProcess::(_processLogs) (66) Got request for method 'access' >Thread-59::DEBUG::2014-09-15 18:21:40,306::__init__::232::IOProcess::(_processLogs) (66) Queuing response >Dummy-65::DEBUG::2014-09-15 18:21:41,160::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-65::DEBUG::2014-09-15 18:21:41,181::storage_mailbox::729::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160079 s, 64.0 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1141850
: 937651 |
937653