Attachment 944068 Details for Bug 1149517 – vdsm log when using xmlrpc

vdsm log when using xmlrpc

vdsm-xmlrpc.log (text/plain), 411.48 KB, created by Nir Soffer on 2014-10-05 18:54:28 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Nir Soffer

Created: 2014-10-05 18:54:28 UTC

Size: 411.48 KB

patch

obsolete

>MainThread::INFO::2014-10-05 21:06:21,628::vdsm::131::vds::(run) (PID: 7304) I am the actual vdsm 4.16.6-0.el6 voodoo1.tlv.redhat.com (2.6.32-431.29.2.el6.x86_64)
>MainThread::DEBUG::2014-10-05 21:06:21,628::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-10-05 21:06:21,628::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500
>MainThread::DEBUG::2014-10-05 21:06:21,630::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt
>MainThread::WARNING::2014-10-05 21:06:21,630::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-10-05 21:06:21,632::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,633::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,633::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,633::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,634::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,634::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,635::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,635::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,635::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:06:21,679::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-10-05 21:06:21,687::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-10-05 21:06:21,687::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None)
>MainThread::DEBUG::2014-10-05 21:06:21,787::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:06:21,788::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-10-05 21:06:21,789::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-10-05 21:06:21,789::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-10-05 21:06:21,789::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-10-05 21:06:21,792::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>storageRefresh::DEBUG::2014-10-05 21:06:21,792::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>MainThread::INFO::2014-10-05 21:06:21,793::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>storageRefresh::DEBUG::2014-10-05 21:06:21,794::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:06:21,806::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-10-05 21:06:21,807::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:06:21,811::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>storageRefresh::DEBUG::2014-10-05 21:06:21,811::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:06:21,835::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>MainThread::DEBUG::2014-10-05 21:06:21,846::task::595::Storage.TaskManager.Task::(_updateState) Task=`1542c581-523d-4088-9363-86aff03eaae7`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:06:21,846::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x28c3550>>)
>MainThread::INFO::2014-10-05 21:06:21,851::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-10-05 21:06:21,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`1542c581-523d-4088-9363-86aff03eaae7`::finished: None
>MainThread::DEBUG::2014-10-05 21:06:21,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`1542c581-523d-4088-9363-86aff03eaae7`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:06:21,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:06:21,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:06:21,851::task::993::Storage.TaskManager.Task::(_decref) Task=`1542c581-523d-4088-9363-86aff03eaae7`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:06:21,852::momIF::49::MOM::(__init__) Starting up MOM
>storageRefresh::DEBUG::2014-10-05 21:06:21,854::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>MainThread::INFO::2014-10-05 21:06:21,860::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds.
>VM Channels Listener::INFO::2014-10-05 21:06:21,861::vmchannels::175::vds::(run) Starting VM channels listener thread.
>clientIFinit::DEBUG::2014-10-05 21:06:21,863::libvirtconnection::150::root::(get) trying to connect libvirt
>MainThread::DEBUG::2014-10-05 21:06:21,876::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x29be758>
>storageRefresh::DEBUG::2014-10-05 21:06:21,876::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:06:21,880::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:21,880::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:21,884::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:21,886::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:21,888::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:21,890::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:21,891::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-10-05 21:06:21,896::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>MainThread::DEBUG::2014-10-05 21:06:21,942::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x2b47950>
>JsonRpcServer::DEBUG::2014-10-05 21:06:21,943::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
>Detector thread::DEBUG::2014-10-05 21:06:21,946::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running
>storageRefresh::DEBUG::2014-10-05 21:06:21,946::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/3600144f09dbd0500000053a85076000a|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None)
>Detector thread::DEBUG::2014-10-05 21:06:21,952::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7
>storageRefresh::DEBUG::2014-10-05 21:06:22,044::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737352704: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737410048: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600144f09dbd0500000053a85076000a was disabled\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:06:22,044::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:22,045::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:22,046::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/3600144f09dbd0500000053a85076000a|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:06:22,121::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737352704: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737410048: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600144f09dbd0500000053a85076000a was disabled\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:06:22,121::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:22,121::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/3600144f09dbd0500000053a85076000a|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:06:22,194::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737352704: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737410048: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600144f09dbd0500000053a85076000a was disabled\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:06:22,194::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:22,194::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/3600144f09dbd0500000053a85076000a|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:06:22,265::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737352704: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737410048: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600144f09dbd0500000053a85076000a was disabled\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:06:22,266::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:06:22,266::hsm::387::Storage.HSM::(storageRefresh) HSM is ready
>Detector thread::DEBUG::2014-10-05 21:06:29,920::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.201.227:33160
>Detector thread::DEBUG::2014-10-05 21:06:30,003::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.201.227:33160
>Detector thread::DEBUG::2014-10-05 21:06:30,003::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.201.227:33160
>Detector thread::DEBUG::2014-10-05 21:06:30,004::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('10.35.201.227', 33160)
>Thread-13::DEBUG::2014-10-05 21:06:30,005::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getCapabilities with () {}
>Thread-13::DEBUG::2014-10-05 21:06:30,059::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,065::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,076::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,086::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,086::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,094::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,095::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,103::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,103::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,111::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,112::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,120::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,121::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,129::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,131::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,140::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,141::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/NFtokZNka5fofA1/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,148::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,149::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,190::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,203::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31
>Thread-13::DEBUG::2014-10-05 21:06:30,203::utils::738::root::(execCmd) numactl --hardware (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,207::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,208::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,211::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,214::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled
>Thread-13::DEBUG::2014-10-05 21:06:30,214::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:nsoffer1'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.29.2.el6.x86_64', 'buildtime': 1406465746.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1412232469L, 'version': '4.16.6'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1408610144L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'mom': {'release': '0.0.master.20140911.gitcf7ff17.el6', 'buildtime': 1410462635L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'mtu': '1500', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'ipv6gateway': '::', 'gateway': '10.35.1.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '193', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.52540087196f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.52540087196f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '93', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': '85CFDED0-FD24-4645-AF7C-D47A088AE9E8', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:87:19:6f', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '52:54:00:87:19:6f', 'speed': 0}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:nsoffer1', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3734', 'cpuSpeed': '3392.160', 'numaNodes': {u'0': {'totalMemory': '3734', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.201.227'}}
>Thread-13::DEBUG::2014-10-05 21:06:30,424::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getHardwareInfo with () {}
>Thread-13::DEBUG::2014-10-05 21:06:30,427::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemUUID': '85cfded0-fd24-4645-af7c-d47a088ae9e8', 'systemManufacturer': 'Bochs'}}
>Thread-13::DEBUG::2014-10-05 21:06:30,691::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getCapabilities with () {} flowID [619163ca]
>Thread-13::DEBUG::2014-10-05 21:06:30,692::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:30,695::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:30,708::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31
>Thread-13::DEBUG::2014-10-05 21:06:30,708::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:nsoffer1'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.29.2.el6.x86_64', 'buildtime': 1406465746.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1412232469L, 'version': '4.16.6'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1408610144L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'mom': {'release': '0.0.master.20140911.gitcf7ff17.el6', 'buildtime': 1410462635L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'mtu': '1500', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'ipv6gateway': '::', 'gateway': '10.35.1.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '142', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.52540087196f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.52540087196f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '42', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': '85CFDED0-FD24-4645-AF7C-D47A088AE9E8', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:87:19:6f', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '52:54:00:87:19:6f', 'speed': 0}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:nsoffer1', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3734', 'cpuSpeed': '3392.160', 'numaNodes': {u'0': {'totalMemory': '3734', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.201.227'}}
>Thread-13::DEBUG::2014-10-05 21:06:30,893::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getHardwareInfo with () {} flowID [619163ca]
>Thread-13::DEBUG::2014-10-05 21:06:30,893::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemUUID': '85cfded0-fd24-4645-af7c-d47a088ae9e8', 'systemManufacturer': 'Bochs'}}
>Thread-13::DEBUG::2014-10-05 21:06:31,463::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227] flowID [19b3f53e]
>Thread-13::DEBUG::2014-10-05 21:06:31,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`7869b7b6-87fb-4d4b-8659-62ad0c77b6fe`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:06:31,464::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='b86b687a-d073-497a-ac8a-249025419a3e', conList=[{'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target1', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf', 'port': '3260'}, {'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b', 'port': '3260'}, {'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target2', 'user': '', 'tpgt': '1', 'password': '******', 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd', 'port': '3260'}], options=None)
>Thread-13::DEBUG::2014-10-05 21:06:31,464::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:31,474::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:31,474::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:32,291::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:32,292::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:32,319::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:32,319::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:32,320::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/3600144f09dbd0500000053a85076000a|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:32,478::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737352704: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 10737410048: Input/output error\n  /dev/mapper/3600144f09dbd0500000053a85076000a: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/3600144f09dbd0500000053a85076000a was disabled\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:32,479::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:32,479::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:06:32,479::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:06:32,479::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:32,508::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:32,509::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:33,081::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:33,083::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:33,112::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:33,112::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:33,113::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/3600144f09dbd0500000053a85076000a|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:33,291::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = "  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474770944: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 21474828288: Input/output error\n  /dev/mapper/1IET_00060007: read failed after 0 of 4096 at 0: Input/output error\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n  WARNING: Error counts reached a limit of 3. Device /dev/mapper/1IET_00060007 was disabled\n  Couldn't find device with uuid 5zWyZx-cpAZ-tMON-3wa5-s6pN-Xj7N-b3fPs5.\n  Couldn't find device with uuid c2LMVb-PXdj-XpTE-4f06-2rrh-TdAG-zzehcn.\n  Couldn't find device with uuid 1kMage-eAId-qy7G-oIqH-tfbH-ScLD-gqv7JM.\n"; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:33,292::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:33,292::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c73a3ced-4b41-4b4e-93f7-494d63e7e7ae',)
>Thread-13::DEBUG::2014-10-05 21:06:33,292::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {c73a3ced-4b41-4b4e-93f7-494d63e7e7ae: storage.blockSD.findDomain}
>Thread-13::DEBUG::2014-10-05 21:06:33,293::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:33,307::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:33,308::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:34,116::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:34,117::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:34,128::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:34,129::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ('c73a3ced-4b41-4b4e-93f7-494d63e7e7ae',)
>Thread-13::DEBUG::2014-10-05 21:06:34,129::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {c73a3ced-4b41-4b4e-93f7-494d63e7e7ae: storage.blockSD.findDomain}
>Thread-13::INFO::2014-10-05 21:06:34,129::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:06:34,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`7869b7b6-87fb-4d4b-8659-62ad0c77b6fe`::finished: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:06:34,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`7869b7b6-87fb-4d4b-8659-62ad0c77b6fe`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:06:34,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:06:34,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:06:34,134::task::993::Storage.TaskManager.Task::(_decref) Task=`7869b7b6-87fb-4d4b-8659-62ad0c77b6fe`::ref 0 aborting False
>Thread-13::DEBUG::2014-10-05 21:06:34,331::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227]
>Thread-13::DEBUG::2014-10-05 21:06:34,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`43f089ff-49f3-4f5b-82bd-502cb80a34eb`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:06:34,332::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b86b687a-d073-497a-ac8a-249025419a3e', hostID=3, msdUUID='ff559f46-c495-4f6b-901c-2a624042a050', masterVersion=5, domainsMap={'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}, options=None)
>Thread-13::DEBUG::2014-10-05 21:06:34,332::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e54bdb9e-f14b-4fa6-9035-345fd51f600f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:06:34,332::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:06:34,332::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:06:34,333::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e54bdb9e-f14b-4fa6-9035-345fd51f600f`::Granted request
>Thread-13::DEBUG::2014-10-05 21:06:34,333::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`2c37b2e3-d021-438c-b866-ef902ff746d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:06:34,333::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:06:34,333::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:06:34,333::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`2c37b2e3-d021-438c-b866-ef902ff746d4`::Granted request
>Thread-13::DEBUG::2014-10-05 21:06:34,334::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 5 and domains map to {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}
>Thread-13::INFO::2014-10-05 21:06:34,334::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 5 and domains map {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'Active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'Active'}
>Thread-13::INFO::2014-10-05 21:06:34,334::sp::133::Storage.StoragePool::(setBackend) updating pool b86b687a-d073-497a-ac8a-249025419a3e backend from type NoneType instance 0x3a11372210 to type StoragePoolMemoryBackend instance 0x7f67200988e8
>Thread-13::INFO::2014-10-05 21:06:34,334::sp::631::Storage.StoragePool::(connect) Connect host #3 to the storage pool b86b687a-d073-497a-ac8a-249025419a3e with master domain: ff559f46-c495-4f6b-901c-2a624042a050 (ver = 5)
>Thread-13::DEBUG::2014-10-05 21:06:34,334::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,334::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,335::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,335::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,335::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,335::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,337::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-13::DEBUG::2014-10-05 21:06:34,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:06:34,338::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-13::DEBUG::2014-10-05 21:06:34,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:06:34,339::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-13::DEBUG::2014-10-05 21:06:34,339::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:34,428::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:06:34,437::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:34,554::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:34,554::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,554::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,554::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,554::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,554::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,554::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,555::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::ERROR::2014-10-05 21:06:34,555::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::ERROR::2014-10-05 21:06:34,555::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:06:34,555::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,558::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:34,793::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:34,793::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,793::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:06:34,794::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata count=1 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:34,798::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000680844 s, 3.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:34,798::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000680844 s, 3.0 MB/s'], size: 2048
>Thread-13::DEBUG::2014-10-05 21:06:34,798::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-13::DEBUG::2014-10-05 21:06:34,799::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-13::DEBUG::2014-10-05 21:06:34,799::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:06:34,799::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,799::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,799::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,799::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,799::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:34,800::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:35,023::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:35,024::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:35,024::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'SDUUID=ff559f46-c495-4f6b-901c-2a624042a050', 'PHYBLKSIZE=512', u'PV0=pv:1IET_00060007,uuid:QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb,pestart:0,pecount:157,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'ROLE=Master', u'PV1=pv:1IET_00060009,uuid:pGRciD-wcLp-X1ME-MijE-P1B9-7XWo-ycTXdG,pestart:0,pecount:157,mapoffset:157', 'DESCRIPTION=jumbo-el7', '_SHA_CKSUM=1695e16fba6531db32e52743127e50d763522d29']
>Thread-13::DEBUG::2014-10-05 21:06:35,025::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_imageNS'
>Thread-13::DEBUG::2014-10-05 21:06:35,025::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_volumeNS'
>Thread-13::DEBUG::2014-10-05 21:06:35,025::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_lvmActivationNS'
>Thread-13::DEBUG::2014-10-05 21:06:35,025::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain ff559f46-c495-4f6b-901c-2a624042a050 verified, version 5
>Thread-13::DEBUG::2014-10-05 21:06:35,025::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-13::DEBUG::2014-10-05 21:06:35,025::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::INFO::2014-10-05 21:06:35,025::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:06:35,026::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `c73a3ced-4b41-4b4e-93f7-494d63e7e7ae`
>Thread-14::DEBUG::2014-10-05 21:06:35,026::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::INFO::2014-10-05 21:06:35,026::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-14::DEBUG::2014-10-05 21:06:35,027::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:35,027::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `ff559f46-c495-4f6b-901c-2a624042a050`
>Thread-15::DEBUG::2014-10-05 21:06:35,027::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-14::DEBUG::2014-10-05 21:06:35,029::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:35,028::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:06:35,037::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e
>Thread-15::DEBUG::2014-10-05 21:06:35,038::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:35,049::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-13::DEBUG::2014-10-05 21:06:35,049::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-15::DEBUG::2014-10-05 21:06:35,180::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:06:35,180::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:06:35,185::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629833 s, 6.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:06:35,189::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain ff559f46-c495-4f6b-901c-2a624042a050 changed its status to Valid
>Thread-15::INFO::2014-10-05 21:06:35,189::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-16::DEBUG::2014-10-05 21:06:35,189::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-16::DEBUG::2014-10-05 21:06:35,190::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-15::DEBUG::2014-10-05 21:06:35,190::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 successfully acquired (id: 3)
>Thread-16::DEBUG::2014-10-05 21:06:35,191::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-17::INFO::2014-10-05 21:06:35,197::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-14::DEBUG::2014-10-05 21:06:35,265::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:35,265::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:06:35,266::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:06:35,270::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00042932 s, 4.8 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:35,270::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00042932 s, 4.8 MB/s'], size: 2048
>Thread-14::DEBUG::2014-10-05 21:06:35,270::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-14::DEBUG::2014-10-05 21:06:35,270::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-14::DEBUG::2014-10-05 21:06:35,271::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:06:35,271::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm reload operation' is holding the operation mutex, waiting...
>Thread-13::DEBUG::2014-10-05 21:06:35,320::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:35,321::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:35,321::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md
>Thread-13::WARNING::2014-10-05 21:06:35,321::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md already exists
>Thread-14::DEBUG::2014-10-05 21:06:35,322::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:35,322::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images
>Thread-13::WARNING::2014-10-05 21:06:35,322::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images already exists
>Thread-14::DEBUG::2014-10-05 21:06:35,323::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::INFO::2014-10-05 21:06:35,324::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:06:35,324::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:06:35,324::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:06:35,324::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:06:35,325::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images
>Thread-14::DEBUG::2014-10-05 21:06:35,325::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::WARNING::2014-10-05 21:06:35,325::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images already exists
>Thread-13::DEBUG::2014-10-05 21:06:35,326::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md
>Thread-13::WARNING::2014-10-05 21:06:35,326::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md already exists
>Thread-14::DEBUG::2014-10-05 21:06:35,326::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::INFO::2014-10-05 21:06:35,331::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:06:35,331::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::INFO::2014-10-05 21:06:35,331::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:06:35,331::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:06:35,332::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500
>Thread-13::DEBUG::2014-10-05 21:06:35,336::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:35,344::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0038067 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::INFO::2014-10-05 21:06:35,345::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-13::DEBUG::2014-10-05 21:06:35,345::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:35,352::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00313839 s, 1.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:35,353::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool b86b687a-d073-497a-ac8a-249025419a3e
>Thread-13::DEBUG::2014-10-05 21:06:35,353::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool b86b687a-d073-497a-ac8a-249025419a3e on master domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:06:35,353::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e'
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records.
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:06:35,354::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-13::INFO::2014-10-05 21:06:35,355::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-13::DEBUG::2014-10-05 21:06:35,355::task::1191::Storage.TaskManager.Task::(prepare) Task=`43f089ff-49f3-4f5b-82bd-502cb80a34eb`::finished: True
>Thread-13::DEBUG::2014-10-05 21:06:35,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`43f089ff-49f3-4f5b-82bd-502cb80a34eb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:06:35,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:06:35,355::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:06:35,355::task::993::Storage.TaskManager.Task::(_decref) Task=`43f089ff-49f3-4f5b-82bd-502cb80a34eb`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:06:35,559::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:35,560::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:06:35,560::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', u'PV1=pv:3600144f09dbd0500000053a84e730003,uuid:5zWyZx-cpAZ-tMON-3wa5-s6pN-Xj7N-b3fPs5,pestart:0,pecount:77,mapoffset:77', 'DESCRIPTION=sasha-el7', 'VERSION=3', u'PV2=pv:3600144f09dbd0500000053a853ed000c,uuid:c2LMVb-PXdj-XpTE-4f06-2rrh-TdAG-zzehcn,pestart:0,pecount:77,mapoffset:154', 'SDUUID=c73a3ced-4b41-4b4e-93f7-494d63e7e7ae', 'LOGBLKSIZE=512', 'TYPE=ISCSI', u'PV3=pv:3600144f09dbd0500000053a85401000d,uuid:1kMage-eAId-qy7G-oIqH-tfbH-ScLD-gqv7JM,pestart:0,pecount:77,mapoffset:231', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'VGUUID=pF71zc-KPBX-BMKm-7KHK-KihY-ysp4-6DZTpA', 'CLASS=Data', 'LOCKPOLICY=', 'ROLE=Regular', u'PV0=pv:3600144f09dbd0500000053a85076000a,uuid:Ka3ewV-ddPQ-boL6-sDJT-xcFb-YBkc-9HeKFq,pestart:0,pecount:77,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', '_SHA_CKSUM=40993341560adfe664d3c1ab0c6b62068addc74c']
>Thread-14::DEBUG::2014-10-05 21:06:35,560::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_imageNS'
>Thread-14::DEBUG::2014-10-05 21:06:35,561::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_volumeNS'
>Thread-14::DEBUG::2014-10-05 21:06:35,561::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_lvmActivationNS'
>Thread-14::DEBUG::2014-10-05 21:06:35,561::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:06:35,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9a744bc-c844-43ee-8728-438b5217d85c`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:06:35,568::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:06:35,568::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000629833', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:06:35,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9a744bc-c844-43ee-8728-438b5217d85c`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000629833', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:06:35,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9a744bc-c844-43ee-8728-438b5217d85c`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:06:35,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:06:35,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:06:35,568::task::993::Storage.TaskManager.Task::(_decref) Task=`b9a744bc-c844-43ee-8728-438b5217d85c`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:06:35,658::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:35,658::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:06:35,662::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000528202 s, 7.8 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:35,663::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae changed its status to Valid
>Thread-14::INFO::2014-10-05 21:06:35,664::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-24::DEBUG::2014-10-05 21:06:35,664::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-24::DEBUG::2014-10-05 21:06:35,664::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-14::DEBUG::2014-10-05 21:06:35,664::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae successfully acquired (id: 3)
>Thread-24::DEBUG::2014-10-05 21:06:35,666::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-25::INFO::2014-10-05 21:06:35,666::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-13::DEBUG::2014-10-05 21:06:35,747::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call setMOMPolicyParameters with ({'balloonEnabled': True, 'ksmEnabled': True},) {} flowID [19b3f53e]
>Thread-13::DEBUG::2014-10-05 21:06:35,783::BindingXMLRPC::1139::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-15::DEBUG::2014-10-05 21:06:45,191::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:06:45,202::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00112004 s, 3.7 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:45,666::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:06:45,670::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000567533 s, 7.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:06:48,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`894d2561-27e8-4217-ba7f-90e335a27b53`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:06:48,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:06:48,591::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000567533', 'lastCheck': '2.9', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00112004', 'lastCheck': '3.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:06:48,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`894d2561-27e8-4217-ba7f-90e335a27b53`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000567533', 'lastCheck': '2.9', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00112004', 'lastCheck': '3.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:06:48,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`894d2561-27e8-4217-ba7f-90e335a27b53`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:06:48,591::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:06:48,592::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:06:48,592::task::993::Storage.TaskManager.Task::(_decref) Task=`894d2561-27e8-4217-ba7f-90e335a27b53`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:06:55,211::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:06:55,216::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000875392 s, 4.7 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:06:55,671::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:06:55,676::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541475 s, 7.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:07:04,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a11ff62-0fb0-43c2-a430-b653cb817edb`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:07:04,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:07:04,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000541475', 'lastCheck': '9.1', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000875392', 'lastCheck': '9.6', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:04,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a11ff62-0fb0-43c2-a430-b653cb817edb`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000541475', 'lastCheck': '9.1', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000875392', 'lastCheck': '9.6', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:04,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a11ff62-0fb0-43c2-a430-b653cb817edb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:07:04,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:07:04,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:07:04,777::task::993::Storage.TaskManager.Task::(_decref) Task=`1a11ff62-0fb0-43c2-a430-b653cb817edb`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:07:05,217::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:07:05,222::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680386 s, 6.0 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:07:05,677::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:07:05,681::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000576536 s, 7.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:07:15,224::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:07:15,229::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0009065 s, 4.5 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:07:15,683::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:07:15,687::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00084129 s, 4.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:07:21,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b2f7958-306f-435d-b18d-abe07adbbd58`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:07:21,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:07:21,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084129', 'lastCheck': '5.4', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0009065', 'lastCheck': '5.8', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:21,074::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b2f7958-306f-435d-b18d-abe07adbbd58`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084129', 'lastCheck': '5.4', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0009065', 'lastCheck': '5.8', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:21,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b2f7958-306f-435d-b18d-abe07adbbd58`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:07:21,074::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:07:21,074::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:07:21,075::task::993::Storage.TaskManager.Task::(_decref) Task=`5b2f7958-306f-435d-b18d-abe07adbbd58`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:07:25,231::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:07:25,235::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757999 s, 5.4 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:07:25,688::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:07:25,693::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633889 s, 6.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:07:35,237::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:07:35,241::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720215 s, 5.7 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:07:35,694::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:07:35,699::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654121 s, 6.3 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:07:37,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`afbcf0e4-cc55-4b2d-a478-80dd087d3794`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:07:37,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:07:37,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654121', 'lastCheck': '1.6', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720215', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:37,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`afbcf0e4-cc55-4b2d-a478-80dd087d3794`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654121', 'lastCheck': '1.6', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720215', 'lastCheck': '2.0', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:37,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`afbcf0e4-cc55-4b2d-a478-80dd087d3794`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:07:37,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:07:37,264::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:07:37,264::task::993::Storage.TaskManager.Task::(_decref) Task=`afbcf0e4-cc55-4b2d-a478-80dd087d3794`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:07:45,243::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:07:45,248::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771541 s, 5.3 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:07:45,700::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:07:45,705::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000569436 s, 7.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:07:53,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5c2b93f-0efc-495e-9bc9-2bc005fcd275`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:07:53,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:07:53,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569436', 'lastCheck': '7.9', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771541', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:53,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5c2b93f-0efc-495e-9bc9-2bc005fcd275`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000569436', 'lastCheck': '7.9', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771541', 'lastCheck': '8.3', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:07:53,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5c2b93f-0efc-495e-9bc9-2bc005fcd275`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:07:53,566::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:07:53,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:07:53,566::task::993::Storage.TaskManager.Task::(_decref) Task=`f5c2b93f-0efc-495e-9bc9-2bc005fcd275`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:07:55,249::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:07:55,255::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114792 s, 3.6 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:07:55,706::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:07:55,710::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000491962 s, 8.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:08:05,257::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:08:05,261::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000739758 s, 5.5 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:08:05,711::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:08:05,716::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000536767 s, 7.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:08:09,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ff292e9-37e4-40f8-b5a4-7aed3f0effdf`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:08:09,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:08:09,827::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536767', 'lastCheck': '4.1', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739758', 'lastCheck': '4.6', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:08:09,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ff292e9-37e4-40f8-b5a4-7aed3f0effdf`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000536767', 'lastCheck': '4.1', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739758', 'lastCheck': '4.6', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:08:09,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ff292e9-37e4-40f8-b5a4-7aed3f0effdf`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:08:09,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:08:09,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:08:09,827::task::993::Storage.TaskManager.Task::(_decref) Task=`1ff292e9-37e4-40f8-b5a4-7aed3f0effdf`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:08:15,263::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:08:15,267::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764786 s, 5.4 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:08:15,717::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:08:15,722::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636547 s, 6.4 MB/s\n'; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:08:16,423::vdsm::58::vds::(sigtermHandler) Received signal 15
>MainThread::DEBUG::2014-10-05 21:08:16,424::protocoldetector::135::vds.MultiProtocolAcceptor::(stop) Stopping Acceptor
>MainThread::INFO::2014-10-05 21:08:16,424::__init__::563::jsonrpc.JsonRpcServer::(stop) Stopping JsonRPC Server
>Detector thread::DEBUG::2014-10-05 21:08:16,424::protocoldetector::106::vds.MultiProtocolAcceptor::(_cleanup) Cleaning Acceptor
>MainThread::INFO::2014-10-05 21:08:16,425::vmchannels::188::vds::(stop) VM channels listener was stopped.
>MainThread::INFO::2014-10-05 21:08:16,425::momIF::91::MOM::(stop) Shutting down MOM
>MainThread::DEBUG::2014-10-05 21:08:16,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3e8b378-9ef3-45f1-b526-7a3404dfb8f5`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:08:16,426::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
>Thread-11::DEBUG::2014-10-05 21:08:16,426::storageServer::706::Storage.ConnectionMonitor::(_monitorConnections) Monitoring stopped
>MainThread::DEBUG::2014-10-05 21:08:16,433::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,433::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,433::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,434::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,434::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,435::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,435::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,436::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:08:16,436::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>VM Channels Listener::INFO::2014-10-05 21:08:16,988::vmchannels::183::vds::(run) VM channels listener thread has ended.
>MainThread::INFO::2014-10-05 21:08:17,342::domainMonitor::137::Storage.DomainMonitor::(close) Stopping domain monitors
>MainThread::INFO::2014-10-05 21:08:17,343::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:08:17,343::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::INFO::2014-10-05 21:08:17,343::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-23::INFO::2014-10-05 21:08:17,362::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail
>Thread-23::INFO::2014-10-05 21:08:17,362::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-23::DEBUG::2014-10-05 21:08:17,362::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-23::DEBUG::2014-10-05 21:08:17,371::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00405577 s, 1.0 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:08:19,344::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae released successfully (id: 3)
>MainThread::INFO::2014-10-05 21:08:19,345::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::DEBUG::2014-10-05 21:08:19,345::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::INFO::2014-10-05 21:08:19,345::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-15::DEBUG::2014-10-05 21:08:22,346::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 released successfully (id: 3)
>MainThread::DEBUG::2014-10-05 21:08:22,346::taskManager::90::Storage.TaskManager::(prepareForShutdown) Request to stop all tasks
>MainThread::INFO::2014-10-05 21:08:22,346::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
>MainThread::DEBUG::2014-10-05 21:08:22,350::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3e8b378-9ef3-45f1-b526-7a3404dfb8f5`::finished: None
>MainThread::DEBUG::2014-10-05 21:08:22,350::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3e8b378-9ef3-45f1-b526-7a3404dfb8f5`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:08:22,351::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:08:22,351::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:08:22,351::task::993::Storage.TaskManager.Task::(_decref) Task=`e3e8b378-9ef3-45f1-b526-7a3404dfb8f5`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::137::vds::(run) VDSM main thread ended. Waiting for 14 other threads...
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::141::vds::(run) <_MainThread(MainThread, started 140082277807872)>
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::141::vds::(run) <Thread(libvirtEventLoop, started daemon 140082188949248)>
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::141::vds::(run) <WorkerThread(Thread-10, started daemon 140081669064448)>
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::141::vds::(run) <WorkerThread(Thread-7, started daemon 140081700534016)>
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::141::vds::(run) <WorkerThread(Thread-1, started daemon 140082103187200)>
>MainThread::INFO::2014-10-05 21:08:22,351::momIF::91::MOM::(stop) Shutting down MOM
>MainThread::INFO::2014-10-05 21:08:22,351::vdsm::141::vds::(run) <MomThread(MOM, started 140081186051840)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-5, started daemon 140082061227776)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-4, started daemon 140082071717632)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-3, started daemon 140082082207488)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-6, started daemon 140082050737920)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-8, started daemon 140081690044160)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-9, started daemon 140081679554304)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140080605812480)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <Thread(Thread-13, started daemon 140081648084736)>
>MainThread::INFO::2014-10-05 21:08:22,352::vdsm::141::vds::(run) <WorkerThread(Thread-2, started daemon 140082092697344)>
>MainThread::INFO::2014-10-05 21:09:01,841::vdsm::131::vds::(run) (PID: 3064) I am the actual vdsm 4.16.6-0.el6 voodoo1.tlv.redhat.com (2.6.32-431.29.2.el6.x86_64)
>MainThread::DEBUG::2014-10-05 21:09:01,853::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-10-05 21:09:01,853::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500
>MainThread::DEBUG::2014-10-05 21:09:01,855::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt
>MainThread::WARNING::2014-10-05 21:09:01,855::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-10-05 21:09:01,861::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,861::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,861::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,862::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,862::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,863::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,863::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,863::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,864::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:01,913::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-10-05 21:09:01,926::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-10-05 21:09:01,926::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None)
>MainThread::DEBUG::2014-10-05 21:09:02,031::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:09:02,031::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-10-05 21:09:02,032::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-10-05 21:09:02,032::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-10-05 21:09:02,032::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-10-05 21:09:02,036::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>storageRefresh::DEBUG::2014-10-05 21:09:02,036::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>MainThread::INFO::2014-10-05 21:09:02,037::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>storageRefresh::DEBUG::2014-10-05 21:09:02,038::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:09:02,056::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-10-05 21:09:02,056::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:09:02,056::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>storageRefresh::DEBUG::2014-10-05 21:09:02,056::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:09:02,069::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>MainThread::DEBUG::2014-10-05 21:09:02,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f20dfc2-87c7-489f-b90b-fd1650b9b844`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:09:02,101::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x2e074d0>>)
>MainThread::INFO::2014-10-05 21:09:02,101::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-10-05 21:09:02,101::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f20dfc2-87c7-489f-b90b-fd1650b9b844`::finished: None
>MainThread::DEBUG::2014-10-05 21:09:02,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f20dfc2-87c7-489f-b90b-fd1650b9b844`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:09:02,101::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:09:02,101::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:09:02,101::task::993::Storage.TaskManager.Task::(_decref) Task=`5f20dfc2-87c7-489f-b90b-fd1650b9b844`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:09:02,102::momIF::49::MOM::(__init__) Starting up MOM
>storageRefresh::DEBUG::2014-10-05 21:09:02,102::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>MainThread::INFO::2014-10-05 21:09:02,113::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds.
>storageRefresh::DEBUG::2014-10-05 21:09:02,114::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>VM Channels Listener::INFO::2014-10-05 21:09:02,116::vmchannels::175::vds::(run) Starting VM channels listener thread.
>clientIFinit::DEBUG::2014-10-05 21:09:02,116::libvirtconnection::150::root::(get) trying to connect libvirt
>storageRefresh::DEBUG::2014-10-05 21:09:02,117::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>MainThread::DEBUG::2014-10-05 21:09:02,123::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x2f3c2d8>
>storageRefresh::DEBUG::2014-10-05 21:09:02,124::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,128::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,129::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,129::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,129::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,129::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-10-05 21:09:02,129::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,151::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None)
>MainThread::DEBUG::2014-10-05 21:09:02,226::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x310d998>
>JsonRpcServer::DEBUG::2014-10-05 21:09:02,226::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
>Detector thread::DEBUG::2014-10-05 21:09:02,228::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running
>Detector thread::DEBUG::2014-10-05 21:09:02,229::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7
>storageRefresh::DEBUG::2014-10-05 21:09:02,238::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:09:02,239::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,239::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,240::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:09:02,312::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:09:02,313::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,313::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:09:02,391::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:09:02,391::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,391::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Detector thread::DEBUG::2014-10-05 21:09:02,416::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.201.227:47079
>storageRefresh::DEBUG::2014-10-05 21:09:02,459::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:09:02,459::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:09:02,459::hsm::387::Storage.HSM::(storageRefresh) HSM is ready
>Detector thread::DEBUG::2014-10-05 21:09:02,507::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.201.227:47079
>Detector thread::DEBUG::2014-10-05 21:09:02,508::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.201.227:47079
>Detector thread::DEBUG::2014-10-05 21:09:02,508::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('10.35.201.227', 47079)
>Thread-13::DEBUG::2014-10-05 21:09:02,509::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getCapabilities with () {}
>Thread-13::DEBUG::2014-10-05 21:09:02,558::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,564::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,578::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,585::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,586::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,593::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,594::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,601::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,602::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,610::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,611::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,618::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,620::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,628::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,635::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,641::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,642::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/mk8615y5nt7fFaS/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,649::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,650::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,679::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,732::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31
>Thread-13::DEBUG::2014-10-05 21:09:02,734::utils::738::root::(execCmd) numactl --hardware (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,737::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,738::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:02,741::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:02,743::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled
>Thread-13::DEBUG::2014-10-05 21:09:02,744::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:nsoffer1'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.29.2.el6.x86_64', 'buildtime': 1406465746.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1412232469L, 'version': '4.16.6'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1408610144L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'mom': {'release': '0.0.master.20140911.gitcf7ff17.el6', 'buildtime': 1410462635L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'mtu': '1500', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'ipv6gateway': '::', 'gateway': '10.35.1.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '83', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.52540087196f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.52540087196f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '83', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': '85CFDED0-FD24-4645-AF7C-D47A088AE9E8', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:87:19:6f', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '52:54:00:87:19:6f', 'speed': 0}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:nsoffer1', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3734', 'cpuSpeed': '3392.160', 'numaNodes': {u'0': {'totalMemory': '3734', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.201.227'}}
>Thread-13::DEBUG::2014-10-05 21:09:02,924::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getHardwareInfo with () {}
>Thread-13::DEBUG::2014-10-05 21:09:02,949::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemUUID': '85cfded0-fd24-4645-af7c-d47a088ae9e8', 'systemManufacturer': 'Bochs'}}
>Thread-13::DEBUG::2014-10-05 21:09:03,453::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227] flowID [65a92b67]
>Thread-13::DEBUG::2014-10-05 21:09:03,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`62e1dff9-7037-485f-8fac-4afda1167a60`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:09:03,454::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='b86b687a-d073-497a-ac8a-249025419a3e', conList=[{'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target1', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf', 'port': '3260'}, {'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b', 'port': '3260'}, {'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target2', 'user': '', 'tpgt': '1', 'password': '******', 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd', 'port': '3260'}], options=None)
>Thread-13::DEBUG::2014-10-05 21:09:03,454::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:03,465::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:03,466::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:04,264::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:04,264::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:04,290::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:04,290::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:04,291::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:04,389::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:04,389::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:04,390::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:09:04,390::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:09:04,390::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:04,409::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:04,410::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:04,998::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:04,999::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:05,015::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:05,015::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:05,015::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:05,122::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:05,122::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:05,122::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:09:05,122::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:09:05,123::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:05,176::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:05,176::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,087::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,087::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,101::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,102::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,102::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,226::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,226::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,226::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:09:06,226::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::INFO::2014-10-05 21:09:06,227::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:09:06,227::task::1191::Storage.TaskManager.Task::(prepare) Task=`62e1dff9-7037-485f-8fac-4afda1167a60`::finished: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:09:06,227::task::595::Storage.TaskManager.Task::(_updateState) Task=`62e1dff9-7037-485f-8fac-4afda1167a60`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:09:06,227::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:09:06,228::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:09:06,228::task::993::Storage.TaskManager.Task::(_decref) Task=`62e1dff9-7037-485f-8fac-4afda1167a60`::ref 0 aborting False
>Thread-13::DEBUG::2014-10-05 21:09:06,430::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227]
>Thread-13::DEBUG::2014-10-05 21:09:06,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`c304d277-1e93-45fe-a56e-aad72abc498f`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:09:06,431::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b86b687a-d073-497a-ac8a-249025419a3e', hostID=3, msdUUID='ff559f46-c495-4f6b-901c-2a624042a050', masterVersion=5, domainsMap={'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}, options=None)
>Thread-13::DEBUG::2014-10-05 21:09:06,432::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`96c10e94-21c6-4adc-91fe-a2f173a4e837`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:09:06,432::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:09:06,432::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:09:06,432::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`96c10e94-21c6-4adc-91fe-a2f173a4e837`::Granted request
>Thread-13::DEBUG::2014-10-05 21:09:06,433::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ff64b937-4400-4745-8cce-baafa9673540`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:09:06,433::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:09:06,433::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:09:06,433::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`ff64b937-4400-4745-8cce-baafa9673540`::Granted request
>Thread-13::DEBUG::2014-10-05 21:09:06,433::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 5 and domains map to {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}
>Thread-13::INFO::2014-10-05 21:09:06,434::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 5 and domains map {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'Active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'Active'}
>Thread-13::INFO::2014-10-05 21:09:06,434::sp::133::Storage.StoragePool::(setBackend) updating pool b86b687a-d073-497a-ac8a-249025419a3e backend from type NoneType instance 0x3a11372210 to type StoragePoolMemoryBackend instance 0x7f55e0052998
>Thread-13::INFO::2014-10-05 21:09:06,434::sp::631::Storage.StoragePool::(connect) Connect host #3 to the storage pool b86b687a-d073-497a-ac8a-249025419a3e with master domain: ff559f46-c495-4f6b-901c-2a624042a050 (ver = 5)
>Thread-13::DEBUG::2014-10-05 21:09:06,434::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,434::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,434::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,435::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,435::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,435::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,435::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-13::DEBUG::2014-10-05 21:09:06,435::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:09:06,435::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-13::DEBUG::2014-10-05 21:09:06,436::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:09:06,436::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-13::DEBUG::2014-10-05 21:09:06,436::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,500::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:09:06,506::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,619::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,620::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,620::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,620::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,620::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,620::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,620::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,620::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::ERROR::2014-10-05 21:09:06,621::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::ERROR::2014-10-05 21:09:06,621::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:09:06,621::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,623::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,843::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,843::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,843::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:09:06,844::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/metadata (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,980::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,980::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,980::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,981::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata count=1 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:06,985::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000664658 s, 3.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:06,985::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000664658 s, 3.1 MB/s'], size: 2048
>Thread-13::DEBUG::2014-10-05 21:09:06,985::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-13::DEBUG::2014-10-05 21:09:06,985::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-13::DEBUG::2014-10-05 21:09:06,985::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:09:06,985::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,985::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,986::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,986::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,986::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:06,986::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,201::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:07,201::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,201::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'SDUUID=ff559f46-c495-4f6b-901c-2a624042a050', 'PHYBLKSIZE=512', u'PV0=pv:1IET_00060007,uuid:QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb,pestart:0,pecount:157,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'ROLE=Master', u'PV1=pv:1IET_00060009,uuid:pGRciD-wcLp-X1ME-MijE-P1B9-7XWo-ycTXdG,pestart:0,pecount:157,mapoffset:157', 'DESCRIPTION=jumbo-el7', '_SHA_CKSUM=1695e16fba6531db32e52743127e50d763522d29']
>Thread-13::DEBUG::2014-10-05 21:09:07,202::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/ids (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,345::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:07,345::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,345::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,345::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/leases (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,494::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:07,495::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,495::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,495::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/inbox ff559f46-c495-4f6b-901c-2a624042a050/outbox ff559f46-c495-4f6b-901c-2a624042a050/master (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,652::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:07,652::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,652::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,653::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_imageNS'
>Thread-13::DEBUG::2014-10-05 21:09:07,653::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_volumeNS'
>Thread-13::DEBUG::2014-10-05 21:09:07,654::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_lvmActivationNS'
>Thread-13::DEBUG::2014-10-05 21:09:07,654::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain ff559f46-c495-4f6b-901c-2a624042a050 verified, version 5
>Thread-13::DEBUG::2014-10-05 21:09:07,654::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-13::DEBUG::2014-10-05 21:09:07,654::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::INFO::2014-10-05 21:09:07,654::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:09:07,655::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:09:07,655::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `c73a3ced-4b41-4b4e-93f7-494d63e7e7ae`
>Thread-14::ERROR::2014-10-05 21:09:07,655::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::INFO::2014-10-05 21:09:07,656::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-14::ERROR::2014-10-05 21:09:07,656::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:09:07,657::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:07,657::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,664::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `ff559f46-c495-4f6b-901c-2a624042a050`
>Thread-15::DEBUG::2014-10-05 21:09:07,665::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:09:07,666::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:09:07,667::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e
>Thread-15::DEBUG::2014-10-05 21:09:07,668::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,675::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,675::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-15::DEBUG::2014-10-05 21:09:07,764::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:09:07,765::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:09:07,769::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000450447 s, 9.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:09:07,772::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain ff559f46-c495-4f6b-901c-2a624042a050 changed its status to Valid
>Thread-16::DEBUG::2014-10-05 21:09:07,773::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-15::INFO::2014-10-05 21:09:07,773::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-16::DEBUG::2014-10-05 21:09:07,774::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-15::DEBUG::2014-10-05 21:09:07,775::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 successfully acquired (id: 3)
>Thread-16::DEBUG::2014-10-05 21:09:07,776::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-17::INFO::2014-10-05 21:09:07,777::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-14::DEBUG::2014-10-05 21:09:07,888::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:07,888::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:09:07,889::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,905::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:07,906::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:09:07,906::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md
>Thread-13::WARNING::2014-10-05 21:09:07,906::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md already exists
>Thread-13::DEBUG::2014-10-05 21:09:07,907::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images
>Thread-13::WARNING::2014-10-05 21:09:07,907::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images already exists
>Thread-13::INFO::2014-10-05 21:09:07,907::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:09:07,907::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:09:07,907::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images
>Thread-13::WARNING::2014-10-05 21:09:07,907::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images already exists
>Thread-13::DEBUG::2014-10-05 21:09:07,908::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md
>Thread-13::WARNING::2014-10-05 21:09:07,908::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md already exists
>Thread-13::INFO::2014-10-05 21:09:07,939::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:09:07,940::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::INFO::2014-10-05 21:09:07,940::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:09:07,940::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:09:07,940::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500
>Thread-13::DEBUG::2014-10-05 21:09:07,942::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,949::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00333931 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::INFO::2014-10-05 21:09:07,949::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-13::DEBUG::2014-10-05 21:09:07,949::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:07,957::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00386635 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:07,958::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool b86b687a-d073-497a-ac8a-249025419a3e
>Thread-13::DEBUG::2014-10-05 21:09:07,958::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool b86b687a-d073-497a-ac8a-249025419a3e on master domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:09:07,958::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e'
>Thread-13::DEBUG::2014-10-05 21:09:07,958::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:09:07,958::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:09:07,958::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records.
>Thread-13::DEBUG::2014-10-05 21:09:07,959::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-13::DEBUG::2014-10-05 21:09:07,959::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:09:07,959::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:09:07,959::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-13::INFO::2014-10-05 21:09:07,959::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-13::DEBUG::2014-10-05 21:09:07,959::task::1191::Storage.TaskManager.Task::(prepare) Task=`c304d277-1e93-45fe-a56e-aad72abc498f`::finished: True
>Thread-13::DEBUG::2014-10-05 21:09:07,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`c304d277-1e93-45fe-a56e-aad72abc498f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:09:07,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:09:07,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:09:07,960::task::993::Storage.TaskManager.Task::(_decref) Task=`c304d277-1e93-45fe-a56e-aad72abc498f`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:09:08,025::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:08,025::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,026::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,026::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:08,030::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000519927 s, 3.9 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:08,030::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000519927 s, 3.9 MB/s'], size: 2048
>Thread-14::DEBUG::2014-10-05 21:09:08,031::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-14::DEBUG::2014-10-05 21:09:08,031::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-14::DEBUG::2014-10-05 21:09:08,031::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:09:08,031::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,031::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,031::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,031::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,031::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,032::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:08,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5cf6a9f-7fa2-4670-bba3-2217697b2454`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:09:08,168::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:09:08,168::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000450447', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:08,169::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5cf6a9f-7fa2-4670-bba3-2217697b2454`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000450447', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:08,169::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5cf6a9f-7fa2-4670-bba3-2217697b2454`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:09:08,169::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:09:08,169::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:09:08,169::task::993::Storage.TaskManager.Task::(_decref) Task=`d5cf6a9f-7fa2-4670-bba3-2217697b2454`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:09:08,251::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:08,252::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,252::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', u'PV1=pv:3600144f09dbd0500000053a84e730003,uuid:5zWyZx-cpAZ-tMON-3wa5-s6pN-Xj7N-b3fPs5,pestart:0,pecount:77,mapoffset:77', 'DESCRIPTION=sasha-el7', 'VERSION=3', u'PV2=pv:3600144f09dbd0500000053a853ed000c,uuid:c2LMVb-PXdj-XpTE-4f06-2rrh-TdAG-zzehcn,pestart:0,pecount:77,mapoffset:154', 'SDUUID=c73a3ced-4b41-4b4e-93f7-494d63e7e7ae', 'LOGBLKSIZE=512', 'TYPE=ISCSI', u'PV3=pv:3600144f09dbd0500000053a85401000d,uuid:1kMage-eAId-qy7G-oIqH-tfbH-ScLD-gqv7JM,pestart:0,pecount:77,mapoffset:231', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'VGUUID=pF71zc-KPBX-BMKm-7KHK-KihY-ysp4-6DZTpA', 'CLASS=Data', 'LOCKPOLICY=', 'ROLE=Regular', u'PV0=pv:3600144f09dbd0500000053a85076000a,uuid:Ka3ewV-ddPQ-boL6-sDJT-xcFb-YBkc-9HeKFq,pestart:0,pecount:77,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', '_SHA_CKSUM=40993341560adfe664d3c1ab0c6b62068addc74c']
>Thread-14::DEBUG::2014-10-05 21:09:08,252::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/ids (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:08,345::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call setMOMPolicyParameters with ({'balloonEnabled': True, 'ksmEnabled': True},) {} flowID [65a92b67]
>Thread-14::DEBUG::2014-10-05 21:09:08,385::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:08,386::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,387::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,388::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/leases (cwd None)
>Thread-13::DEBUG::2014-10-05 21:09:08,401::BindingXMLRPC::1139::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-14::DEBUG::2014-10-05 21:09:08,524::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:08,524::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,524::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:08,524::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/inbox c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/outbox c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/master (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:09,324::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:09,324::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:09,325::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:09:09,325::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_imageNS'
>Thread-14::DEBUG::2014-10-05 21:09:09,325::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_volumeNS'
>Thread-14::DEBUG::2014-10-05 21:09:09,325::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_lvmActivationNS'
>Thread-14::DEBUG::2014-10-05 21:09:09,326::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:09,420::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:09,420::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:09,424::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00050575 s, 8.1 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:09,425::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae changed its status to Valid
>Thread-24::DEBUG::2014-10-05 21:09:09,425::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-14::INFO::2014-10-05 21:09:09,425::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-24::DEBUG::2014-10-05 21:09:09,426::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-14::DEBUG::2014-10-05 21:09:09,426::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae successfully acquired (id: 3)
>Thread-24::DEBUG::2014-10-05 21:09:09,427::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-25::INFO::2014-10-05 21:09:09,428::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-13::DEBUG::2014-10-05 21:09:11,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc6b4ada-7c02-4ae8-9138-0cf9739c0db4`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:09:11,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:09:11,697::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00050575', 'lastCheck': '2.3', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000450447', 'lastCheck': '3.9', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:11,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc6b4ada-7c02-4ae8-9138-0cf9739c0db4`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00050575', 'lastCheck': '2.3', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000450447', 'lastCheck': '3.9', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:11,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc6b4ada-7c02-4ae8-9138-0cf9739c0db4`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:09:11,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:09:11,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:09:11,697::task::993::Storage.TaskManager.Task::(_decref) Task=`bc6b4ada-7c02-4ae8-9138-0cf9739c0db4`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:09:17,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:09:17,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103157 s, 4.0 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:19,428::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:19,442::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000616337 s, 6.6 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:09:27,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:09:27,788::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683757 s, 6.0 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:27,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8bc6ef5-5a17-4957-8791-463080df19d7`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:09:27,969::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:09:27,969::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000616337', 'lastCheck': '8.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000683757', 'lastCheck': '0.2', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:27,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8bc6ef5-5a17-4957-8791-463080df19d7`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000616337', 'lastCheck': '8.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000683757', 'lastCheck': '0.2', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:27,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8bc6ef5-5a17-4957-8791-463080df19d7`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:09:27,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:09:27,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:09:27,969::task::993::Storage.TaskManager.Task::(_decref) Task=`f8bc6ef5-5a17-4957-8791-463080df19d7`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:09:29,445::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:29,449::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568701 s, 7.2 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:09:37,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:09:37,796::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000705296 s, 5.8 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:09:39,450::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:09:39,454::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00055279 s, 7.4 MB/s\n'; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:09:43,714::vdsm::58::vds::(sigtermHandler) Received signal 15
>MainThread::DEBUG::2014-10-05 21:09:43,718::protocoldetector::135::vds.MultiProtocolAcceptor::(stop) Stopping Acceptor
>MainThread::INFO::2014-10-05 21:09:43,718::__init__::563::jsonrpc.JsonRpcServer::(stop) Stopping JsonRPC Server
>Detector thread::DEBUG::2014-10-05 21:09:43,719::protocoldetector::106::vds.MultiProtocolAcceptor::(_cleanup) Cleaning Acceptor
>MainThread::INFO::2014-10-05 21:09:43,719::vmchannels::188::vds::(stop) VM channels listener was stopped.
>MainThread::INFO::2014-10-05 21:09:43,719::momIF::91::MOM::(stop) Shutting down MOM
>MainThread::DEBUG::2014-10-05 21:09:43,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`7edbd47d-469b-4b57-b1db-cbda43343e12`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:09:43,720::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
>Thread-11::DEBUG::2014-10-05 21:09:43,721::storageServer::706::Storage.ConnectionMonitor::(_monitorConnections) Monitoring stopped
>MainThread::DEBUG::2014-10-05 21:09:43,722::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,723::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,723::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,723::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,724::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,724::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,725::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,725::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:09:43,726::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>MainThread::INFO::2014-10-05 21:09:43,944::domainMonitor::137::Storage.DomainMonitor::(close) Stopping domain monitors
>MainThread::INFO::2014-10-05 21:09:43,944::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:09:43,944::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::INFO::2014-10-05 21:09:43,944::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-23::INFO::2014-10-05 21:09:43,960::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail
>Thread-23::INFO::2014-10-05 21:09:43,961::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-23::DEBUG::2014-10-05 21:09:43,961::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-23::DEBUG::2014-10-05 21:09:43,968::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0037188 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:09:44,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`135b45d8-050d-4a47-a7b0-4d78a513ca22`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:09:44,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:09:44,134::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055279', 'lastCheck': '4.7', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705296', 'lastCheck': '6.3', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:44,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`135b45d8-050d-4a47-a7b0-4d78a513ca22`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00055279', 'lastCheck': '4.7', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000705296', 'lastCheck': '6.3', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:09:44,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`135b45d8-050d-4a47-a7b0-4d78a513ca22`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:09:44,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:09:44,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:09:44,135::task::993::Storage.TaskManager.Task::(_decref) Task=`135b45d8-050d-4a47-a7b0-4d78a513ca22`::ref 0 aborting False
>VM Channels Listener::INFO::2014-10-05 21:09:44,170::vmchannels::183::vds::(run) VM channels listener thread has ended.
>Thread-14::DEBUG::2014-10-05 21:09:45,945::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae released successfully (id: 3)
>MainThread::INFO::2014-10-05 21:09:45,945::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::DEBUG::2014-10-05 21:09:45,945::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::INFO::2014-10-05 21:09:45,945::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-15::DEBUG::2014-10-05 21:09:47,946::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 released successfully (id: 3)
>MainThread::DEBUG::2014-10-05 21:09:47,946::taskManager::90::Storage.TaskManager::(prepareForShutdown) Request to stop all tasks
>MainThread::INFO::2014-10-05 21:09:47,946::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
>MainThread::DEBUG::2014-10-05 21:09:47,946::task::1191::Storage.TaskManager.Task::(prepare) Task=`7edbd47d-469b-4b57-b1db-cbda43343e12`::finished: None
>MainThread::DEBUG::2014-10-05 21:09:47,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`7edbd47d-469b-4b57-b1db-cbda43343e12`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:09:47,947::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:09:47,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:09:47,947::task::993::Storage.TaskManager.Task::(_decref) Task=`7edbd47d-469b-4b57-b1db-cbda43343e12`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::137::vds::(run) VDSM main thread ended. Waiting for 14 other threads...
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <_MainThread(MainThread, started 140008187397888)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <Thread(libvirtEventLoop, started daemon 140008099071744)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-7, started daemon 140007612348160)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-10, started daemon 140007580878592)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-2, started daemon 140008004511488)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <Thread(Thread-13, started daemon 140007559898880)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-4, started daemon 140007983531776)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-3, started daemon 140007994021632)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-6, started daemon 140007962552064)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-1, started daemon 140008015001344)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-9, started daemon 140007591368448)>
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <WorkerThread(Thread-5, started daemon 140007973041920)>
>MainThread::INFO::2014-10-05 21:09:47,947::momIF::91::MOM::(stop) Shutting down MOM
>MainThread::INFO::2014-10-05 21:09:47,947::vdsm::141::vds::(run) <MomThread(MOM, started 140007095576320)>
>MainThread::INFO::2014-10-05 21:09:47,948::vdsm::141::vds::(run) <WorkerThread(Thread-8, started daemon 140007601858304)>
>MainThread::INFO::2014-10-05 21:09:47,948::vdsm::141::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140006450517760)>
>MainThread::INFO::2014-10-05 21:10:33,490::vdsm::131::vds::(run) (PID: 3063) I am the actual vdsm 4.16.6-0.el6 voodoo1.tlv.redhat.com (2.6.32-431.29.2.el6.x86_64)
>MainThread::DEBUG::2014-10-05 21:10:33,502::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-10-05 21:10:33,502::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500
>MainThread::DEBUG::2014-10-05 21:10:33,504::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt
>MainThread::WARNING::2014-10-05 21:10:33,504::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-10-05 21:10:33,511::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,512::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,512::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,513::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,513::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,514::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,514::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,514::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,515::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:10:33,569::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-10-05 21:10:33,580::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-10-05 21:10:33,581::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None)
>MainThread::DEBUG::2014-10-05 21:10:33,695::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:10:33,695::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-10-05 21:10:33,698::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-10-05 21:10:33,698::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-10-05 21:10:33,698::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-10-05 21:10:33,701::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>storageRefresh::DEBUG::2014-10-05 21:10:33,701::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>MainThread::INFO::2014-10-05 21:10:33,703::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>storageRefresh::DEBUG::2014-10-05 21:10:33,703::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:10:33,707::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-10-05 21:10:33,715::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:10:33,716::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>storageRefresh::DEBUG::2014-10-05 21:10:33,717::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:10:33,746::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>MainThread::DEBUG::2014-10-05 21:10:33,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`676ed44f-d482-4e52-8549-64be1807afaf`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:10:33,761::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x183a4d0>>)
>MainThread::INFO::2014-10-05 21:10:33,761::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-10-05 21:10:33,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`676ed44f-d482-4e52-8549-64be1807afaf`::finished: None
>MainThread::DEBUG::2014-10-05 21:10:33,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`676ed44f-d482-4e52-8549-64be1807afaf`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:10:33,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:10:33,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:10:33,762::task::993::Storage.TaskManager.Task::(_decref) Task=`676ed44f-d482-4e52-8549-64be1807afaf`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:10:33,762::momIF::49::MOM::(__init__) Starting up MOM
>MainThread::INFO::2014-10-05 21:10:33,765::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds.
>clientIFinit::DEBUG::2014-10-05 21:10:33,769::libvirtconnection::150::root::(get) trying to connect libvirt
>VM Channels Listener::INFO::2014-10-05 21:10:33,769::vmchannels::175::vds::(run) Starting VM channels listener thread.
>storageRefresh::DEBUG::2014-10-05 21:10:33,773::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>MainThread::DEBUG::2014-10-05 21:10:33,789::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x19327a0>
>storageRefresh::DEBUG::2014-10-05 21:10:33,790::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:10:33,799::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,799::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,801::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,802::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,806::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,808::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,814::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-10-05 21:10:33,820::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,844::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None)
>MainThread::DEBUG::2014-10-05 21:10:33,857::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x1afea70>
>JsonRpcServer::DEBUG::2014-10-05 21:10:33,857::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
>Detector thread::DEBUG::2014-10-05 21:10:33,859::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running
>Detector thread::DEBUG::2014-10-05 21:10:33,859::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7
>storageRefresh::DEBUG::2014-10-05 21:10:33,939::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:10:33,940::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,941::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:33,942::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:10:34,020::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:10:34,020::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:34,020::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:10:34,090::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:10:34,090::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:34,090::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:10:34,160::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:10:34,160::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:10:34,160::hsm::387::Storage.HSM::(storageRefresh) HSM is ready
>Detector thread::DEBUG::2014-10-05 21:10:35,305::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.201.227:55252
>Detector thread::DEBUG::2014-10-05 21:10:35,390::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.201.227:55252
>Detector thread::DEBUG::2014-10-05 21:10:35,390::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.201.227:55252
>Detector thread::DEBUG::2014-10-05 21:10:35,391::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('10.35.201.227', 55252)
>Thread-13::DEBUG::2014-10-05 21:10:35,392::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getCapabilities with () {}
>Thread-13::DEBUG::2014-10-05 21:10:35,442::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,448::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,462::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,472::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,472::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,480::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,480::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,492::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,493::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,500::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,501::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,510::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,511::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,519::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,520::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,526::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,527::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/y5FxECOUF6bOV8n/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,534::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,535::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,564::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,607::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31
>Thread-13::DEBUG::2014-10-05 21:10:35,609::utils::738::root::(execCmd) numactl --hardware (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,613::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,614::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:35,617::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:35,619::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled
>Thread-13::DEBUG::2014-10-05 21:10:35,620::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:nsoffer1'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.29.2.el6.x86_64', 'buildtime': 1406465746.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1412232469L, 'version': '4.16.6'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1408610144L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'mom': {'release': '0.0.master.20140911.gitcf7ff17.el6', 'buildtime': 1410462635L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'mtu': '1500', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'ipv6gateway': '::', 'gateway': '10.35.1.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '194', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.52540087196f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.52540087196f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '94', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': '85CFDED0-FD24-4645-AF7C-D47A088AE9E8', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:87:19:6f', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '52:54:00:87:19:6f', 'speed': 0}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:nsoffer1', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3734', 'cpuSpeed': '3392.160', 'numaNodes': {u'0': {'totalMemory': '3734', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.201.227'}}
>Thread-13::DEBUG::2014-10-05 21:10:35,800::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getHardwareInfo with () {}
>Thread-13::DEBUG::2014-10-05 21:10:35,825::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemUUID': '85cfded0-fd24-4645-af7c-d47a088ae9e8', 'systemManufacturer': 'Bochs'}}
>Thread-13::DEBUG::2014-10-05 21:10:36,301::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227] flowID [4f017b58]
>Thread-13::DEBUG::2014-10-05 21:10:36,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`58c15ab9-280d-46b0-82fd-f3b88c5ad974`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:10:36,302::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='b86b687a-d073-497a-ac8a-249025419a3e', conList=[{'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target1', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf', 'port': '3260'}, {'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b', 'port': '3260'}, {'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target2', 'user': '', 'tpgt': '1', 'password': '******', 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd', 'port': '3260'}], options=None)
>Thread-13::DEBUG::2014-10-05 21:10:36,302::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:36,314::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:36,314::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,106::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,106::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,115::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,116::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:37,116::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,217::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,217::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:37,217::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:10:37,218::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:10:37,218::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,235::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,236::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,849::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,850::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,866::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,866::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:37,867::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:37,984::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:37,985::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:37,985::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:10:37,985::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:10:37,985::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:38,006::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:38,006::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:38,810::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:38,811::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:38,822::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:38,822::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:38,822::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:38,935::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:38,935::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:38,935::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:10:38,935::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::INFO::2014-10-05 21:10:38,936::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:10:38,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`58c15ab9-280d-46b0-82fd-f3b88c5ad974`::finished: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:10:38,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`58c15ab9-280d-46b0-82fd-f3b88c5ad974`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:10:38,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:10:38,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:10:38,942::task::993::Storage.TaskManager.Task::(_decref) Task=`58c15ab9-280d-46b0-82fd-f3b88c5ad974`::ref 0 aborting False
>Thread-13::DEBUG::2014-10-05 21:10:39,129::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227]
>Thread-13::DEBUG::2014-10-05 21:10:39,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f9981fb-9bb5-46a3-9692-3ef77c3cb2bb`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:10:39,129::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b86b687a-d073-497a-ac8a-249025419a3e', hostID=3, msdUUID='ff559f46-c495-4f6b-901c-2a624042a050', masterVersion=5, domainsMap={'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}, options=None)
>Thread-13::DEBUG::2014-10-05 21:10:39,130::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`d393b755-96e6-4610-8347-72a74d06feb7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:10:39,130::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:10:39,130::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:10:39,130::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`d393b755-96e6-4610-8347-72a74d06feb7`::Granted request
>Thread-13::DEBUG::2014-10-05 21:10:39,131::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`c680b82f-0572-447c-a6e7-6e168027e8d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:10:39,131::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:10:39,131::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:10:39,131::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`c680b82f-0572-447c-a6e7-6e168027e8d4`::Granted request
>Thread-13::DEBUG::2014-10-05 21:10:39,132::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 5 and domains map to {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}
>Thread-13::INFO::2014-10-05 21:10:39,132::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 5 and domains map {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'Active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'Active'}
>Thread-13::INFO::2014-10-05 21:10:39,132::sp::133::Storage.StoragePool::(setBackend) updating pool b86b687a-d073-497a-ac8a-249025419a3e backend from type NoneType instance 0x3a11372210 to type StoragePoolMemoryBackend instance 0x7f369c055940
>Thread-13::INFO::2014-10-05 21:10:39,132::sp::631::Storage.StoragePool::(connect) Connect host #3 to the storage pool b86b687a-d073-497a-ac8a-249025419a3e with master domain: ff559f46-c495-4f6b-901c-2a624042a050 (ver = 5)
>Thread-13::DEBUG::2014-10-05 21:10:39,132::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,132::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,132::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,132::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,133::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,133::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,133::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-13::DEBUG::2014-10-05 21:10:39,133::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:10:39,133::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-13::DEBUG::2014-10-05 21:10:39,133::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:10:39,133::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-13::DEBUG::2014-10-05 21:10:39,133::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:39,204::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:10:39,213::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:39,336::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:39,336::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,336::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,337::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,337::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,337::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,337::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,337::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::ERROR::2014-10-05 21:10:39,337::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::ERROR::2014-10-05 21:10:39,337::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:10:39,337::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:39,339::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,018::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,019::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,019::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:10:40,019::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/metadata (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,161::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,161::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,161::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,161::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata count=1 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,166::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000787074 s, 2.6 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,166::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000787074 s, 2.6 MB/s'], size: 2048
>Thread-13::DEBUG::2014-10-05 21:10:40,166::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-13::DEBUG::2014-10-05 21:10:40,166::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-13::DEBUG::2014-10-05 21:10:40,166::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:10:40,167::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,167::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,167::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,167::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,167::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,167::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,389::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,389::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,389::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'SDUUID=ff559f46-c495-4f6b-901c-2a624042a050', 'PHYBLKSIZE=512', u'PV0=pv:1IET_00060007,uuid:QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb,pestart:0,pecount:157,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'ROLE=Master', u'PV1=pv:1IET_00060009,uuid:pGRciD-wcLp-X1ME-MijE-P1B9-7XWo-ycTXdG,pestart:0,pecount:157,mapoffset:157', 'DESCRIPTION=jumbo-el7', '_SHA_CKSUM=1695e16fba6531db32e52743127e50d763522d29']
>Thread-13::DEBUG::2014-10-05 21:10:40,390::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/ids (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,527::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,527::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,527::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,528::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/leases (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,664::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,664::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,665::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,665::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/inbox ff559f46-c495-4f6b-901c-2a624042a050/outbox ff559f46-c495-4f6b-901c-2a624042a050/master (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,821::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:40,822::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,822::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,822::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_imageNS'
>Thread-13::DEBUG::2014-10-05 21:10:40,823::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_volumeNS'
>Thread-13::DEBUG::2014-10-05 21:10:40,823::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_lvmActivationNS'
>Thread-13::DEBUG::2014-10-05 21:10:40,823::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain ff559f46-c495-4f6b-901c-2a624042a050 verified, version 5
>Thread-13::DEBUG::2014-10-05 21:10:40,823::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-13::DEBUG::2014-10-05 21:10:40,823::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::INFO::2014-10-05 21:10:40,823::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:10:40,824::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `c73a3ced-4b41-4b4e-93f7-494d63e7e7ae`
>Thread-14::DEBUG::2014-10-05 21:10:40,824::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::INFO::2014-10-05 21:10:40,824::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-14::ERROR::2014-10-05 21:10:40,824::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::ERROR::2014-10-05 21:10:40,825::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:10:40,825::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:40,825::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-15::DEBUG::2014-10-05 21:10:40,833::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:10:40,833::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `ff559f46-c495-4f6b-901c-2a624042a050`
>Thread-13::DEBUG::2014-10-05 21:10:40,837::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-15::DEBUG::2014-10-05 21:10:40,837::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:40,837::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e
>Thread-13::DEBUG::2014-10-05 21:10:40,846::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-13::DEBUG::2014-10-05 21:10:40,846::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-15::DEBUG::2014-10-05 21:10:40,942::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:10:40,942::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:10:40,947::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000429627 s, 9.5 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:10:40,950::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain ff559f46-c495-4f6b-901c-2a624042a050 changed its status to Valid
>Thread-15::INFO::2014-10-05 21:10:40,951::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-16::DEBUG::2014-10-05 21:10:40,951::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-16::DEBUG::2014-10-05 21:10:40,951::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-15::DEBUG::2014-10-05 21:10:40,952::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 successfully acquired (id: 3)
>Thread-16::DEBUG::2014-10-05 21:10:40,952::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-17::INFO::2014-10-05 21:10:40,953::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-14::DEBUG::2014-10-05 21:10:41,054::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,055::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:10:41,055::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:41,079::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:41,080::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:10:41,080::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md
>Thread-13::WARNING::2014-10-05 21:10:41,080::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md already exists
>Thread-13::DEBUG::2014-10-05 21:10:41,080::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images
>Thread-13::WARNING::2014-10-05 21:10:41,080::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images already exists
>Thread-13::INFO::2014-10-05 21:10:41,080::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:10:41,081::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:10:41,081::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images
>Thread-13::WARNING::2014-10-05 21:10:41,081::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images already exists
>Thread-13::DEBUG::2014-10-05 21:10:41,081::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md
>Thread-13::WARNING::2014-10-05 21:10:41,081::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md already exists
>Thread-13::INFO::2014-10-05 21:10:41,107::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:10:41,107::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::INFO::2014-10-05 21:10:41,107::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:10:41,107::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:10:41,107::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500
>Thread-13::DEBUG::2014-10-05 21:10:41,110::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:41,117::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00366812 s, 1.1 MB/s\n'; <rc> = 0
>Thread-13::INFO::2014-10-05 21:10:41,117::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-13::DEBUG::2014-10-05 21:10:41,117::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:41,124::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00334515 s, 1.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:10:41,125::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool b86b687a-d073-497a-ac8a-249025419a3e
>Thread-13::DEBUG::2014-10-05 21:10:41,125::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool b86b687a-d073-497a-ac8a-249025419a3e on master domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:10:41,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e'
>Thread-13::DEBUG::2014-10-05 21:10:41,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:10:41,126::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:10:41,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records.
>Thread-13::DEBUG::2014-10-05 21:10:41,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-13::DEBUG::2014-10-05 21:10:41,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:10:41,127::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:10:41,127::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-13::INFO::2014-10-05 21:10:41,127::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-13::DEBUG::2014-10-05 21:10:41,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f9981fb-9bb5-46a3-9692-3ef77c3cb2bb`::finished: True
>Thread-13::DEBUG::2014-10-05 21:10:41,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f9981fb-9bb5-46a3-9692-3ef77c3cb2bb`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:10:41,127::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:10:41,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:10:41,127::task::993::Storage.TaskManager.Task::(_decref) Task=`9f9981fb-9bb5-46a3-9692-3ef77c3cb2bb`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:10:41,206::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,206::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,206::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,206::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:10:41,210::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000584938 s, 3.5 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,211::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000584938 s, 3.5 MB/s'], size: 2048
>Thread-14::DEBUG::2014-10-05 21:10:41,211::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-14::DEBUG::2014-10-05 21:10:41,211::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-14::DEBUG::2014-10-05 21:10:41,211::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:10:41,211::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,211::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,212::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,212::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,212::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,212::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:41,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7cdb534-01b6-436a-90a9-e0706c82f494`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:10:41,339::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:10:41,340::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000429627', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:10:41,340::task::1191::Storage.TaskManager.Task::(prepare) Task=`b7cdb534-01b6-436a-90a9-e0706c82f494`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000429627', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:10:41,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`b7cdb534-01b6-436a-90a9-e0706c82f494`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:10:41,340::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:10:41,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:10:41,340::task::993::Storage.TaskManager.Task::(_decref) Task=`b7cdb534-01b6-436a-90a9-e0706c82f494`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:10:41,434::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,434::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,434::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', u'PV1=pv:3600144f09dbd0500000053a84e730003,uuid:5zWyZx-cpAZ-tMON-3wa5-s6pN-Xj7N-b3fPs5,pestart:0,pecount:77,mapoffset:77', 'DESCRIPTION=sasha-el7', 'VERSION=3', u'PV2=pv:3600144f09dbd0500000053a853ed000c,uuid:c2LMVb-PXdj-XpTE-4f06-2rrh-TdAG-zzehcn,pestart:0,pecount:77,mapoffset:154', 'SDUUID=c73a3ced-4b41-4b4e-93f7-494d63e7e7ae', 'LOGBLKSIZE=512', 'TYPE=ISCSI', u'PV3=pv:3600144f09dbd0500000053a85401000d,uuid:1kMage-eAId-qy7G-oIqH-tfbH-ScLD-gqv7JM,pestart:0,pecount:77,mapoffset:231', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'VGUUID=pF71zc-KPBX-BMKm-7KHK-KihY-ysp4-6DZTpA', 'CLASS=Data', 'LOCKPOLICY=', 'ROLE=Regular', u'PV0=pv:3600144f09dbd0500000053a85076000a,uuid:Ka3ewV-ddPQ-boL6-sDJT-xcFb-YBkc-9HeKFq,pestart:0,pecount:77,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', '_SHA_CKSUM=40993341560adfe664d3c1ab0c6b62068addc74c']
>Thread-14::DEBUG::2014-10-05 21:10:41,434::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/ids (cwd None)
>Thread-13::DEBUG::2014-10-05 21:10:41,516::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call setMOMPolicyParameters with ({'balloonEnabled': True, 'ksmEnabled': True},) {} flowID [4f017b58]
>Thread-13::DEBUG::2014-10-05 21:10:41,561::BindingXMLRPC::1139::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-14::DEBUG::2014-10-05 21:10:41,603::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,603::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,603::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,604::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/leases (cwd None)
>Thread-14::DEBUG::2014-10-05 21:10:41,742::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,742::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,742::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,743::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/inbox c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/outbox c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/master (cwd None)
>Thread-14::DEBUG::2014-10-05 21:10:41,878::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,879::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,879::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:10:41,879::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_imageNS'
>Thread-14::DEBUG::2014-10-05 21:10:41,880::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_volumeNS'
>Thread-14::DEBUG::2014-10-05 21:10:41,880::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_lvmActivationNS'
>Thread-14::DEBUG::2014-10-05 21:10:41,880::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-14::DEBUG::2014-10-05 21:10:41,975::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,975::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:10:41,979::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000541077 s, 7.6 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:41,980::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae changed its status to Valid
>Thread-14::INFO::2014-10-05 21:10:41,980::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-24::DEBUG::2014-10-05 21:10:41,980::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-24::DEBUG::2014-10-05 21:10:41,981::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-14::DEBUG::2014-10-05 21:10:41,981::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae successfully acquired (id: 3)
>Thread-24::DEBUG::2014-10-05 21:10:41,982::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-25::INFO::2014-10-05 21:10:41,983::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-13::DEBUG::2014-10-05 21:10:48,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`89280e7e-1ce4-4c25-89a1-c1a3a3181046`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:10:48,006::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:10:48,006::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000541077', 'lastCheck': '6.0', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000429627', 'lastCheck': '7.1', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:10:48,006::task::1191::Storage.TaskManager.Task::(prepare) Task=`89280e7e-1ce4-4c25-89a1-c1a3a3181046`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000541077', 'lastCheck': '6.0', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000429627', 'lastCheck': '7.1', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:10:48,006::task::595::Storage.TaskManager.Task::(_updateState) Task=`89280e7e-1ce4-4c25-89a1-c1a3a3181046`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:10:48,006::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:10:48,006::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:10:48,006::task::993::Storage.TaskManager.Task::(_decref) Task=`89280e7e-1ce4-4c25-89a1-c1a3a3181046`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:10:50,953::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:10:50,958::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697209 s, 5.9 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:10:51,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:10:51,988::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00125453 s, 3.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:11:00,960::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:11:00,966::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634197 s, 6.5 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:11:01,990::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:11:01,994::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000571582 s, 7.2 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:11:04,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`993f1230-fde8-4616-af2a-846ee8b3fd62`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:11:04,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:11:04,153::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000571582', 'lastCheck': '2.2', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000634197', 'lastCheck': '3.2', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:11:04,153::task::1191::Storage.TaskManager.Task::(prepare) Task=`993f1230-fde8-4616-af2a-846ee8b3fd62`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000571582', 'lastCheck': '2.2', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000634197', 'lastCheck': '3.2', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:11:04,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`993f1230-fde8-4616-af2a-846ee8b3fd62`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:11:04,153::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:11:04,153::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:11:04,153::task::993::Storage.TaskManager.Task::(_decref) Task=`993f1230-fde8-4616-af2a-846ee8b3fd62`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:11:10,971::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:11:10,976::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657671 s, 6.2 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:11:11,995::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:11:12,000::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601034 s, 6.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:11:20,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1329c33-c799-447c-a6f9-5f64fa2779c9`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:11:20,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:11:20,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601034', 'lastCheck': '8.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657671', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:11:20,522::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1329c33-c799-447c-a6f9-5f64fa2779c9`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000601034', 'lastCheck': '8.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657671', 'lastCheck': '9.5', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:11:20,522::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1329c33-c799-447c-a6f9-5f64fa2779c9`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:11:20,522::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:11:20,522::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:11:20,522::task::993::Storage.TaskManager.Task::(_decref) Task=`e1329c33-c799-447c-a6f9-5f64fa2779c9`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:11:20,978::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:11:20,982::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703443 s, 5.8 MB/s\n'; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:11:21,037::vdsm::58::vds::(sigtermHandler) Received signal 15
>MainThread::DEBUG::2014-10-05 21:11:21,041::protocoldetector::135::vds.MultiProtocolAcceptor::(stop) Stopping Acceptor
>MainThread::INFO::2014-10-05 21:11:21,042::__init__::563::jsonrpc.JsonRpcServer::(stop) Stopping JsonRPC Server
>Detector thread::DEBUG::2014-10-05 21:11:21,042::protocoldetector::106::vds.MultiProtocolAcceptor::(_cleanup) Cleaning Acceptor
>MainThread::INFO::2014-10-05 21:11:21,042::vmchannels::188::vds::(stop) VM channels listener was stopped.
>MainThread::INFO::2014-10-05 21:11:21,043::momIF::91::MOM::(stop) Shutting down MOM
>MainThread::DEBUG::2014-10-05 21:11:21,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d22b3ce-a1fb-45ed-ae8e-eea0d48c9c7c`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:11:21,043::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None)
>Thread-11::DEBUG::2014-10-05 21:11:21,044::storageServer::706::Storage.ConnectionMonitor::(_monitorConnections) Monitoring stopped
>MainThread::DEBUG::2014-10-05 21:11:21,045::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,046::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,046::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,047::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,047::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,047::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,048::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,048::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:11:21,049::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>Thread-23::INFO::2014-10-05 21:11:21,129::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail
>Thread-23::INFO::2014-10-05 21:11:21,129::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-23::DEBUG::2014-10-05 21:11:21,129::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-23::DEBUG::2014-10-05 21:11:21,137::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00402143 s, 1.0 MB/s\n'; <rc> = 0
>VM Channels Listener::INFO::2014-10-05 21:11:21,825::vmchannels::183::vds::(run) VM channels listener thread has ended.
>Thread-14::DEBUG::2014-10-05 21:11:22,001::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:11:22,005::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000588961 s, 7.0 MB/s\n'; <rc> = 0
>MainThread::INFO::2014-10-05 21:11:23,111::domainMonitor::137::Storage.DomainMonitor::(close) Stopping domain monitors
>MainThread::INFO::2014-10-05 21:11:23,111::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:11:23,111::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::INFO::2014-10-05 21:11:23,112::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-14::DEBUG::2014-10-05 21:11:25,112::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae released successfully (id: 3)
>MainThread::INFO::2014-10-05 21:11:25,112::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::DEBUG::2014-10-05 21:11:25,112::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::INFO::2014-10-05 21:11:25,112::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-15::DEBUG::2014-10-05 21:11:27,113::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 released successfully (id: 3)
>MainThread::DEBUG::2014-10-05 21:11:27,113::taskManager::90::Storage.TaskManager::(prepareForShutdown) Request to stop all tasks
>MainThread::INFO::2014-10-05 21:11:27,113::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None
>MainThread::DEBUG::2014-10-05 21:11:27,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d22b3ce-a1fb-45ed-ae8e-eea0d48c9c7c`::finished: None
>MainThread::DEBUG::2014-10-05 21:11:27,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d22b3ce-a1fb-45ed-ae8e-eea0d48c9c7c`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:11:27,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:11:27,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:11:27,114::task::993::Storage.TaskManager.Task::(_decref) Task=`4d22b3ce-a1fb-45ed-ae8e-eea0d48c9c7c`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::137::vds::(run) VDSM main thread ended. Waiting for 12 other threads...
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <_MainThread(MainThread, started 139873904195328)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <Thread(libvirtEventLoop, started daemon 139873815869184)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-10, started daemon 139873296041728)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-1, started daemon 139873730164480)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-5, started daemon 139873688205056)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-2, started daemon 139873719674624)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-4, started daemon 139873698694912)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-9, started daemon 139873306531584)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-8, started daemon 139873317021440)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-7, started daemon 139873327511296)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-3, started daemon 139873709184768)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <Thread(Thread-13, started daemon 139873275062016)>
>MainThread::INFO::2014-10-05 21:11:27,114::vdsm::141::vds::(run) <WorkerThread(Thread-6, started daemon 139873677715200)>
>MainThread::INFO::2014-10-05 21:12:05,081::vdsm::131::vds::(run) (PID: 3059) I am the actual vdsm 4.16.6-0.el6 voodoo1.tlv.redhat.com (2.6.32-431.29.2.el6.x86_64)
>MainThread::DEBUG::2014-10-05 21:12:05,092::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage'
>MainThread::DEBUG::2014-10-05 21:12:05,092::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500
>MainThread::DEBUG::2014-10-05 21:12:05,093::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt
>MainThread::WARNING::2014-10-05 21:12:05,094::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists
>MainThread::DEBUG::2014-10-05 21:12:05,100::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/04511d19-f03a-469a-9e31-ab51d6e75a56/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,100::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/67ba7199-44ec-4562-9c17-ebc3903c7c7f/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,100::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/83d26f74-2a29-4025-8210-5ab61cb49a82/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,101::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/fd98c9a9-23f9-43f5-8e7b-4022f5bdd683/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,101::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/b9c2b835-cdbd-48ea-8d69-7a33042c79b1/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,102::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/c175b488-c93a-4dff-b709-b137853eab67/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,102::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/6ca7f5aa-6229-4549-9c6f-54ec7b7099a6/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,103::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/681bd5bc-4d98-4da3-bd9a-cd37eec7b9af/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,103::sp::381::Storage.StoragePool::(cleanupMasterMount) master `/rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/master` is not mounted, skipping
>MainThread::DEBUG::2014-10-05 21:12:05,155::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm
>MainThread::DEBUG::2014-10-05 21:12:05,170::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving
>MainThread::DEBUG::2014-10-05 21:12:05,170::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None)
>MainThread::DEBUG::2014-10-05 21:12:05,266::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0
>MainThread::DEBUG::2014-10-05 21:12:05,266::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center'
>MainThread::DEBUG::2014-10-05 21:12:05,268::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt']
>MainThread::DEBUG::2014-10-05 21:12:05,268::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: []
>MainThread::DEBUG::2014-10-05 21:12:05,268::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers
>MainThread::DEBUG::2014-10-05 21:12:05,271::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center'
>MainThread::INFO::2014-10-05 21:12:05,272::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher...
>storageRefresh::DEBUG::2014-10-05 21:12:05,272::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>storageRefresh::DEBUG::2014-10-05 21:12:05,275::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:12:05,277::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>storageRefresh::DEBUG::2014-10-05 21:12:05,289::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>storageRefresh::DEBUG::2014-10-05 21:12:05,289::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>storageRefresh::DEBUG::2014-10-05 21:12:05,290::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>MainThread::DEBUG::2014-10-05 21:12:05,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`5db2dea3-cc83-4a29-b522-cad6cac4a7aa`::moving from state init -> state preparing
>MainThread::INFO::2014-10-05 21:12:05,329::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x2d7b690>>)
>MainThread::INFO::2014-10-05 21:12:05,330::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None
>MainThread::DEBUG::2014-10-05 21:12:05,330::task::1191::Storage.TaskManager.Task::(prepare) Task=`5db2dea3-cc83-4a29-b522-cad6cac4a7aa`::finished: None
>MainThread::DEBUG::2014-10-05 21:12:05,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`5db2dea3-cc83-4a29-b522-cad6cac4a7aa`::moving from state preparing -> state finished
>MainThread::DEBUG::2014-10-05 21:12:05,330::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>MainThread::DEBUG::2014-10-05 21:12:05,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>MainThread::DEBUG::2014-10-05 21:12:05,330::task::993::Storage.TaskManager.Task::(_decref) Task=`5db2dea3-cc83-4a29-b522-cad6cac4a7aa`::ref 0 aborting False
>MainThread::INFO::2014-10-05 21:12:05,330::momIF::49::MOM::(__init__) Starting up MOM
>MainThread::INFO::2014-10-05 21:12:05,333::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds.
>VM Channels Listener::INFO::2014-10-05 21:12:05,335::vmchannels::175::vds::(run) Starting VM channels listener thread.
>clientIFinit::DEBUG::2014-10-05 21:12:05,336::libvirtconnection::150::root::(get) trying to connect libvirt
>MainThread::DEBUG::2014-10-05 21:12:05,354::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x2e70950>
>MainThread::DEBUG::2014-10-05 21:12:05,393::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x3047758>
>JsonRpcServer::DEBUG::2014-10-05 21:12:05,393::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request
>Detector thread::DEBUG::2014-10-05 21:12:05,395::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running
>Detector thread::DEBUG::2014-10-05 21:12:05,396::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7
>storageRefresh::DEBUG::2014-10-05 21:12:07,300::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-10-05 21:12:07,305::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:12:07,317::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>storageRefresh::DEBUG::2014-10-05 21:12:07,318::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,319::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:12:07,402::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:12:07,402::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,402::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,402::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:12:07,470::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:12:07,470::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,471::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:12:07,539::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:12:07,539::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,539::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>storageRefresh::DEBUG::2014-10-05 21:12:07,608::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>storageRefresh::DEBUG::2014-10-05 21:12:07,608::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>storageRefresh::DEBUG::2014-10-05 21:12:07,608::hsm::387::Storage.HSM::(storageRefresh) HSM is ready
>Detector thread::DEBUG::2014-10-05 21:12:07,634::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.201.227:45259
>Detector thread::DEBUG::2014-10-05 21:12:07,721::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.201.227:45259
>Detector thread::DEBUG::2014-10-05 21:12:07,721::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.201.227:45259
>Detector thread::DEBUG::2014-10-05 21:12:07,721::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('10.35.201.227', 45259)
>Thread-13::DEBUG::2014-10-05 21:12:07,723::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getCapabilities with () {}
>Thread-13::DEBUG::2014-10-05 21:12:07,773::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,778::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,789::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,800::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,800::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,807::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,808::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,815::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,816::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,824::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,825::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,832::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,833::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,841::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,842::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,849::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,850::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/FNWjJX2ktyN3OTi/bonding/mode (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,857::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,858::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,892::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,936::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31
>Thread-13::DEBUG::2014-10-05 21:12:07,936::utils::738::root::(execCmd) numactl --hardware (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,940::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,941::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:07,944::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:07,946::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled
>Thread-13::DEBUG::2014-10-05 21:12:07,947::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:nsoffer1'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.29.2.el6.x86_64', 'buildtime': 1406465746.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '0.el6', 'buildtime': 1412232469L, 'version': '4.16.6'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1408610144L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1408575896L, 'version': '0.12.1.2'}, 'mom': {'release': '0.0.master.20140911.gitcf7ff17.el6', 'buildtime': 1410462635L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {}, 'cpuSockets': '8', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 1, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'gateway': '10.35.1.254', 'bootproto4': 'dhcp', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '10.35.0.100', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5054:ff:fe87:196f/64'], 'mtu': '1500', 'netmask': '255.255.254.0', 'stp': 'off', 'ipv4addrs': ['10.35.0.100/23'], 'ipv6gateway': '::', 'gateway': '10.35.1.254', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '159', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.52540087196f', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.52540087196f', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '59', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': '85CFDED0-FD24-4645-AF7C-D47A088AE9E8', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '52:54:00:87:19:6f', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '52:54:00:87:19:6f', 'speed': 0}}, 'software_revision': '0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,ss,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,f16c,rdrand,hypervisor,lahf_lm,abm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:nsoffer1', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3734', 'cpuSpeed': '3392.160', 'numaNodes': {u'0': {'totalMemory': '3734', 'cpus': [0, 1, 2, 3, 4, 5, 6, 7]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '8', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '8', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.201.227'}}
>Thread-13::DEBUG::2014-10-05 21:12:08,143::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call getHardwareInfo with () {}
>Thread-13::DEBUG::2014-10-05 21:12:08,167::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'Bochs', 'systemUUID': '85cfded0-fd24-4645-af7c-d47a088ae9e8', 'systemManufacturer': 'Bochs'}}
>Thread-13::DEBUG::2014-10-05 21:12:08,636::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227] flowID [1e7e6e15]
>Thread-13::DEBUG::2014-10-05 21:12:08,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fff4d1f-bb35-4800-ac40-7ef2a82518ca`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:12:08,637::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='b86b687a-d073-497a-ac8a-249025419a3e', conList=[{'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target1', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf', 'port': '3260'}, {'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b', 'port': '3260'}, {'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target2', 'user': '', 'tpgt': '1', 'password': '******', 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd', 'port': '3260'}], options=None)
>Thread-13::DEBUG::2014-10-05 21:12:08,637::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:08,647::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:08,648::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:09,436::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:09,436::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target1 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:09,445::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:09,445::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:09,445::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:09,571::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:09,571::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:09,572::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:12:09,572::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:12:09,572::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:09,586::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:09,586::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:10,141::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:10,142::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:target6 -I default -p 10.35.0.98:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:10,157::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:10,157::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:10,157::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:10,278::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:10,280::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:10,280::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:12:10,280::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::DEBUG::2014-10-05 21:12:10,281::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 --op=new (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:10,333::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:10,334::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -l (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:11,168::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:11,168::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1994-05.com.redhat:nsoffer-target2 -I default -p 10.35.16.25:3260,1 -n node.startup -v manual --op=update (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:11,187::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:11,187::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,187::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:11,315::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = '  No volume groups found\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:11,315::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,316::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: ()
>Thread-13::DEBUG::2014-10-05 21:12:11,316::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {}
>Thread-13::INFO::2014-10-05 21:12:11,316::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:12:11,323::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fff4d1f-bb35-4800-ac40-7ef2a82518ca`::finished: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:12:11,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fff4d1f-bb35-4800-ac40-7ef2a82518ca`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:12:11,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:12:11,324::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:12:11,324::task::993::Storage.TaskManager.Task::(_decref) Task=`2fff4d1f-bb35-4800-ac40-7ef2a82518ca`::ref 0 aborting False
>Thread-13::DEBUG::2014-10-05 21:12:11,532::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227]
>Thread-13::DEBUG::2014-10-05 21:12:11,532::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d2d6bf4-b4e2-445d-842c-83baa778070f`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:12:11,533::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='b86b687a-d073-497a-ac8a-249025419a3e', hostID=3, msdUUID='ff559f46-c495-4f6b-901c-2a624042a050', masterVersion=5, domainsMap={'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}, options=None)
>Thread-13::DEBUG::2014-10-05 21:12:11,533::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5cfce91f-cea1-4b40-b0bf-3fba10fc79fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:12:11,533::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:12:11,533::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:12:11,533::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`5cfce91f-cea1-4b40-b0bf-3fba10fc79fc`::Granted request
>Thread-13::DEBUG::2014-10-05 21:12:11,534::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`3e6484d5-f4cc-4b1f-af0d-93e239b4fdda`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:12:11,534::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:12:11,534::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:12:11,534::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`3e6484d5-f4cc-4b1f-af0d-93e239b4fdda`::Granted request
>Thread-13::DEBUG::2014-10-05 21:12:11,535::spbackends::485::Storage.StoragePoolMemoryBackend::(updateVersionAndDomains) updating domain version to 5 and domains map to {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'active'}
>Thread-13::INFO::2014-10-05 21:12:11,535::spbackends::433::Storage.StoragePoolMemoryBackend::(setDomainsMap) new storage pool master version 5 and domains map {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': 'Active', 'ff559f46-c495-4f6b-901c-2a624042a050': 'Active'}
>Thread-13::INFO::2014-10-05 21:12:11,535::sp::133::Storage.StoragePool::(setBackend) updating pool b86b687a-d073-497a-ac8a-249025419a3e backend from type NoneType instance 0x3a11372210 to type StoragePoolMemoryBackend instance 0x7f54180977e0
>Thread-13::INFO::2014-10-05 21:12:11,535::sp::631::Storage.StoragePool::(connect) Connect host #3 to the storage pool b86b687a-d073-497a-ac8a-249025419a3e with master domain: ff559f46-c495-4f6b-901c-2a624042a050 (ver = 5)
>Thread-13::DEBUG::2014-10-05 21:12:11,535::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,535::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,536::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,536::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,536::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,536::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,536::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-13::DEBUG::2014-10-05 21:12:11,536::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:12:11,536::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-13::DEBUG::2014-10-05 21:12:11,536::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:12:11,536::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-13::DEBUG::2014-10-05 21:12:11,536::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:11,576::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:12:11,582::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:11,684::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:11,684::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,684::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,684::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,684::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,684::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,685::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,685::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::ERROR::2014-10-05 21:12:11,685::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::ERROR::2014-10-05 21:12:11,685::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:12:11,685::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,687::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:11,895::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:11,895::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:11,896::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:12:11,896::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/metadata (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,038::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,038::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,039::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,039::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata count=1 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,043::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000713344 s, 2.9 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,043::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000713344 s, 2.9 MB/s'], size: 2048
>Thread-13::DEBUG::2014-10-05 21:12:12,043::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-13::DEBUG::2014-10-05 21:12:12,043::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-13::DEBUG::2014-10-05 21:12:12,043::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-13::DEBUG::2014-10-05 21:12:12,044::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,044::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,044::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,044::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,044::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,044::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,250::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,250::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,250::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'VGUUID=1B1oT5-JcGj-Ru1I-v3Ni-yden-Du9b-I9fSu8', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'LOGBLKSIZE=512', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'LOCKPOLICY=', 'SDUUID=ff559f46-c495-4f6b-901c-2a624042a050', 'PHYBLKSIZE=512', u'PV0=pv:1IET_00060007,uuid:QfuzQ5-Ml7u-kFUc-gdmr-rfmS-Aefp-3HODNb,pestart:0,pecount:157,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', 'ROLE=Master', u'PV1=pv:1IET_00060009,uuid:pGRciD-wcLp-X1ME-MijE-P1B9-7XWo-ycTXdG,pestart:0,pecount:157,mapoffset:157', 'DESCRIPTION=jumbo-el7', '_SHA_CKSUM=1695e16fba6531db32e52743127e50d763522d29']
>Thread-13::DEBUG::2014-10-05 21:12:12,251::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/ids (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,384::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,384::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,384::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,384::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/leases (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,523::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,523::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,523::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,523::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y ff559f46-c495-4f6b-901c-2a624042a050/inbox ff559f46-c495-4f6b-901c-2a624042a050/outbox ff559f46-c495-4f6b-901c-2a624042a050/master (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,661::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,662::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,662::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,663::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_imageNS'
>Thread-13::DEBUG::2014-10-05 21:12:12,663::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_volumeNS'
>Thread-13::DEBUG::2014-10-05 21:12:12,663::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'ff559f46-c495-4f6b-901c-2a624042a050_lvmActivationNS'
>Thread-13::DEBUG::2014-10-05 21:12:12,663::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain ff559f46-c495-4f6b-901c-2a624042a050 verified, version 5
>Thread-13::DEBUG::2014-10-05 21:12:12,663::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads)
>Thread-13::DEBUG::2014-10-05 21:12:12,663::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::INFO::2014-10-05 21:12:12,663::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:12:12,664::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `c73a3ced-4b41-4b4e-93f7-494d63e7e7ae`
>Thread-14::DEBUG::2014-10-05 21:12:12,664::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::INFO::2014-10-05 21:12:12,664::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-14::ERROR::2014-10-05 21:12:12,665::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::ERROR::2014-10-05 21:12:12,665::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:12:12,665::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `b86b687a-d073-497a-ac8a-249025419a3e` started monitoring domain `ff559f46-c495-4f6b-901c-2a624042a050`
>Thread-15::DEBUG::2014-10-05 21:12:12,665::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:12:12,667::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:12:12,668::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e
>Thread-14::DEBUG::2014-10-05 21:12:12,668::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-15::DEBUG::2014-10-05 21:12:12,669::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060009|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' ff559f46-c495-4f6b-901c-2a624042a050 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:12,677::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,686::lvm::365::Storage.OperationMutex::(_reloadvgs) Got the operational mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,686::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-15::DEBUG::2014-10-05 21:12:12,766::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:12:12,766::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:12:12,771::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000442296 s, 9.3 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:12:12,774::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain ff559f46-c495-4f6b-901c-2a624042a050 changed its status to Valid
>Thread-16::DEBUG::2014-10-05 21:12:12,775::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-15::INFO::2014-10-05 21:12:12,775::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-16::DEBUG::2014-10-05 21:12:12,775::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-15::DEBUG::2014-10-05 21:12:12,776::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 successfully acquired (id: 3)
>Thread-16::DEBUG::2014-10-05 21:12:12,776::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-17::INFO::2014-10-05 21:12:12,777::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-14::DEBUG::2014-10-05 21:12:12,908::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:12,908::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:12:12,908::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,916::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,917::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:12:12,917::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md
>Thread-13::WARNING::2014-10-05 21:12:12,917::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/dom_md already exists
>Thread-13::DEBUG::2014-10-05 21:12:12,917::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images
>Thread-13::WARNING::2014-10-05 21:12:12,918::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/images already exists
>Thread-13::INFO::2014-10-05 21:12:12,918::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:12:12,918::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-13::DEBUG::2014-10-05 21:12:12,918::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images
>Thread-13::WARNING::2014-10-05 21:12:12,918::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/images already exists
>Thread-13::DEBUG::2014-10-05 21:12:12,918::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md
>Thread-13::WARNING::2014-10-05 21:12:12,919::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050/dom_md already exists
>Thread-13::INFO::2014-10-05 21:12:12,939::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:12:12,939::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::INFO::2014-10-05 21:12:12,939::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:12:12,939::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/blockSD/ff559f46-c495-4f6b-901c-2a624042a050 to /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd
>Thread-13::DEBUG::2014-10-05 21:12:12,939::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500
>Thread-13::DEBUG::2014-10-05 21:12:12,941::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd if=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,950::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00395117 s, 1.0 MB/s\n'; <rc> = 0
>Thread-13::INFO::2014-10-05 21:12:12,950::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-13::DEBUG::2014-10-05 21:12:12,951::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:12,958::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00292042 s, 1.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:12,958::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool b86b687a-d073-497a-ac8a-249025419a3e
>Thread-13::DEBUG::2014-10-05 21:12:12,959::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool b86b687a-d073-497a-ac8a-249025419a3e on master domain ff559f46-c495-4f6b-901c-2a624042a050
>Thread-13::DEBUG::2014-10-05 21:12:12,959::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e'
>Thread-13::DEBUG::2014-10-05 21:12:12,959::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:12:12,959::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:12:12,959::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records.
>Thread-13::DEBUG::2014-10-05 21:12:12,959::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-13::DEBUG::2014-10-05 21:12:12,959::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:12:12,960::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:12:12,960::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-13::INFO::2014-10-05 21:12:12,960::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True
>Thread-13::DEBUG::2014-10-05 21:12:12,960::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d2d6bf4-b4e2-445d-842c-83baa778070f`::finished: True
>Thread-13::DEBUG::2014-10-05 21:12:12,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d2d6bf4-b4e2-445d-842c-83baa778070f`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:12:12,960::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:12:12,960::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:12:12,960::task::993::Storage.TaskManager.Task::(_decref) Task=`8d2d6bf4-b4e2-445d-842c-83baa778070f`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:12:13,065::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,065::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,065::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,066::blockSD::336::Storage.Misc.excCmd::(readlines) /bin/dd iflag=direct skip=0 bs=2048 if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:13,070::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000646503 s, 3.2 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,070::misc::262::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000646503 s, 3.2 MB/s'], size: 2048
>Thread-14::DEBUG::2014-10-05 21:12:13,070::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[]
>Thread-14::DEBUG::2014-10-05 21:12:13,070::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata
>Thread-14::DEBUG::2014-10-05 21:12:13,071::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend
>Thread-14::DEBUG::2014-10-05 21:12:13,071::lvm::495::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,071::lvm::497::Storage.OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,071::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,071::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,071::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,071::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/1IET_00060001|/dev/mapper/1IET_00060002|/dev/mapper/1IET_00060003|/dev/mapper/1IET_00060004|/dev/mapper/1IET_00060005|/dev/mapper/1IET_00060006|/dev/mapper/1IET_00060007|/dev/mapper/1IET_00060008|/dev/mapper/1IET_00060009|/dev/mapper/1IET_0006000a|/dev/mapper/3600144f09dbd05000000522dde040011|/dev/mapper/3600144f09dbd05000000522dde050012|/dev/mapper/3600144f09dbd05000000522dde070013|/dev/mapper/3600144f09dbd05000000522dde090014|/dev/mapper/3600144f09dbd05000000522dde0a0015|/dev/mapper/3600144f09dbd05000000522dde0c0016|/dev/mapper/3600144f09dbd05000000522dde0d0017|/dev/mapper/3600144f09dbd05000000522dde0f0018|/dev/mapper/3600144f09dbd05000000522dde100019|/dev/mapper/3600144f09dbd05000000522dde12001a|/dev/mapper/3600144f09dbd0500000053a84cba0002|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a84f4d0004|/dev/mapper/3600144f09dbd0500000053a8503b0005|/dev/mapper/3600144f09dbd0500000053a850500006|/dev/mapper/3600144f09dbd0500000053a8505b0007|/dev/mapper/3600144f09dbd0500000053a850640008|/dev/mapper/3600144f09dbd0500000053a8506c0009|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a8507f000b|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|/dev/mapper/3600144f09dbd0500000053a85409000e|/dev/mapper/3600144f09dbd0500000053a85410000f|/dev/mapper/3600144f09dbd0500000053a854180010|/dev/mapper/3600144f09dbd0500000053a854250011|/dev/mapper/3600144f09dbd0500000053a8542d0012|/dev/mapper/3600144f09dbd0500000053a8543e0013|/dev/mapper/3600144f09dbd0500000053a854450014|/dev/mapper/3600144f09dbd0500000053a8544d0015|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:13,170::task::595::Storage.TaskManager.Task::(_updateState) Task=`69f2a100-4f5d-437e-a27d-8e8943fd3c5b`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:12:13,171::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:12:13,171::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000442296', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:13,171::task::1191::Storage.TaskManager.Task::(prepare) Task=`69f2a100-4f5d-437e-a27d-8e8943fd3c5b`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.5', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000442296', 'lastCheck': '0.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:13,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`69f2a100-4f5d-437e-a27d-8e8943fd3c5b`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:12:13,171::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:12:13,171::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:12:13,171::task::993::Storage.TaskManager.Task::(_decref) Task=`69f2a100-4f5d-437e-a27d-8e8943fd3c5b`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:12:13,286::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,286::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,286::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', u'PV1=pv:3600144f09dbd0500000053a84e730003,uuid:5zWyZx-cpAZ-tMON-3wa5-s6pN-Xj7N-b3fPs5,pestart:0,pecount:77,mapoffset:77', 'DESCRIPTION=sasha-el7', 'VERSION=3', u'PV2=pv:3600144f09dbd0500000053a853ed000c,uuid:c2LMVb-PXdj-XpTE-4f06-2rrh-TdAG-zzehcn,pestart:0,pecount:77,mapoffset:154', 'SDUUID=c73a3ced-4b41-4b4e-93f7-494d63e7e7ae', 'LOGBLKSIZE=512', 'TYPE=ISCSI', u'PV3=pv:3600144f09dbd0500000053a85401000d,uuid:1kMage-eAId-qy7G-oIqH-tfbH-ScLD-gqv7JM,pestart:0,pecount:77,mapoffset:231', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'VGUUID=pF71zc-KPBX-BMKm-7KHK-KihY-ysp4-6DZTpA', 'CLASS=Data', 'LOCKPOLICY=', 'ROLE=Regular', u'PV0=pv:3600144f09dbd0500000053a85076000a,uuid:Ka3ewV-ddPQ-boL6-sDJT-xcFb-YBkc-9HeKFq,pestart:0,pecount:77,mapoffset:0', 'POOL_UUID=b86b687a-d073-497a-ac8a-249025419a3e', '_SHA_CKSUM=40993341560adfe664d3c1ab0c6b62068addc74c']
>Thread-14::DEBUG::2014-10-05 21:12:13,287::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/ids (cwd None)
>Thread-13::DEBUG::2014-10-05 21:12:13,347::BindingXMLRPC::1132::vds::(wrapper) client [10.35.201.227]::call setMOMPolicyParameters with ({'balloonEnabled': True, 'ksmEnabled': True},) {} flowID [1e7e6e15]
>Thread-13::DEBUG::2014-10-05 21:12:13,402::BindingXMLRPC::1139::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}}
>Thread-14::DEBUG::2014-10-05 21:12:13,425::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,425::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,425::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,426::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/leases (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:13,561::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,562::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,562::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,562::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvchange --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' --autobackup n --available y c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/inbox c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/outbox c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/master (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:13,699::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,699::lvm::505::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,699::lvm::517::Storage.OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-14::DEBUG::2014-10-05 21:12:13,700::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_imageNS'
>Thread-14::DEBUG::2014-10-05 21:12:13,700::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_volumeNS'
>Thread-14::DEBUG::2014-10-05 21:12:13,700::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae_lvmActivationNS'
>Thread-14::DEBUG::2014-10-05 21:12:13,700::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgck --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''a|/dev/mapper/3600144f09dbd0500000053a84e730003|/dev/mapper/3600144f09dbd0500000053a85076000a|/dev/mapper/3600144f09dbd0500000053a853ed000c|/dev/mapper/3600144f09dbd0500000053a85401000d|'\'', '\''r|.*|'\'' ] }  global {  locking_type=1  prioritise_write_locks=1  wait_for_locks=1  use_lvmetad=0 }  backup {  retain_min = 50  retain_days = 0 } ' c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:13,794::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,794::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:13,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000605246 s, 6.8 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:13,799::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae changed its status to Valid
>Thread-24::DEBUG::2014-10-05 21:12:13,800::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event
>Thread-14::INFO::2014-10-05 21:12:13,800::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-24::DEBUG::2014-10-05 21:12:13,801::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms`
>Thread-14::DEBUG::2014-10-05 21:12:13,801::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae successfully acquired (id: 3)
>Thread-24::DEBUG::2014-10-05 21:12:13,801::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted
>Thread-25::INFO::2014-10-05 21:12:13,802::clientIF::136::vds::(contEIOVms) vmContainerLock acquired
>Thread-15::DEBUG::2014-10-05 21:12:22,777::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:12:22,782::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000763938 s, 5.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:23,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1c4c03f-8809-426d-afa1-614f7e30d9ec`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:12:23,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:12:23,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000605246', 'lastCheck': '9.2', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000763938', 'lastCheck': '0.2', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:23,016::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1c4c03f-8809-426d-afa1-614f7e30d9ec`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000605246', 'lastCheck': '9.2', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000763938', 'lastCheck': '0.2', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:23,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1c4c03f-8809-426d-afa1-614f7e30d9ec`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:12:23,016::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:12:23,016::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:12:23,016::task::993::Storage.TaskManager.Task::(_decref) Task=`e1c4c03f-8809-426d-afa1-614f7e30d9ec`::ref 0 aborting False
>Thread-14::DEBUG::2014-10-05 21:12:23,802::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:23,807::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579435 s, 7.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:12:32,784::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:12:32,791::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00095048 s, 4.3 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:33,808::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:33,814::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000603289 s, 6.8 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:39,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed097b62-cce9-487c-9e91-2c804a1aef57`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:12:39,221::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:12:39,225::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000603289', 'lastCheck': '5.4', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00095048', 'lastCheck': '6.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:39,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed097b62-cce9-487c-9e91-2c804a1aef57`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000603289', 'lastCheck': '5.4', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00095048', 'lastCheck': '6.4', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:39,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed097b62-cce9-487c-9e91-2c804a1aef57`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:12:39,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:12:39,226::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:12:39,226::task::993::Storage.TaskManager.Task::(_decref) Task=`ed097b62-cce9-487c-9e91-2c804a1aef57`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:12:42,799::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:12:42,803::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703218 s, 5.8 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:43,815::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:43,819::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000575658 s, 7.1 MB/s\n'; <rc> = 0
>Thread-15::DEBUG::2014-10-05 21:12:52,805::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:12:52,810::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703458 s, 5.8 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:12:53,820::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:12:53,825::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000642557 s, 6.4 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:12:55,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8d9ff08-6719-449a-95ef-f12ffcd67e4a`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:12:55,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:12:55,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642557', 'lastCheck': '1.6', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703458', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:55,422::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8d9ff08-6719-449a-95ef-f12ffcd67e4a`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000642557', 'lastCheck': '1.6', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703458', 'lastCheck': '2.6', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:12:55,422::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8d9ff08-6719-449a-95ef-f12ffcd67e4a`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:12:55,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:12:55,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:12:55,422::task::993::Storage.TaskManager.Task::(_decref) Task=`e8d9ff08-6719-449a-95ef-f12ffcd67e4a`::ref 0 aborting False
>Thread-15::DEBUG::2014-10-05 21:13:02,812::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:13:02,816::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611941 s, 6.7 MB/s\n'; <rc> = 0
>Thread-14::DEBUG::2014-10-05 21:13:03,826::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/c73a3ced-4b41-4b4e-93f7-494d63e7e7ae/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-14::DEBUG::2014-10-05 21:13:03,830::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000634707 s, 6.5 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:13:11,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfd0e5da-49c1-4ef9-8f51-07751eec3261`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:13:11,575::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None)
>Thread-13::INFO::2014-10-05 21:13:11,575::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634707', 'lastCheck': '7.7', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611941', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:13:11,575::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfd0e5da-49c1-4ef9-8f51-07751eec3261`::finished: {'c73a3ced-4b41-4b4e-93f7-494d63e7e7ae': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634707', 'lastCheck': '7.7', 'valid': True}, 'ff559f46-c495-4f6b-901c-2a624042a050': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611941', 'lastCheck': '8.8', 'valid': True}}
>Thread-13::DEBUG::2014-10-05 21:13:11,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfd0e5da-49c1-4ef9-8f51-07751eec3261`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:13:11,575::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:13:11,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:13:11,575::task::993::Storage.TaskManager.Task::(_decref) Task=`bfd0e5da-49c1-4ef9-8f51-07751eec3261`::ref 0 aborting False
>Thread-13::DEBUG::2014-10-05 21:13:12,085::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227]
>Thread-13::DEBUG::2014-10-05 21:13:12,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0df4f54-45da-4726-8dd9-93c91432f990`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:13:12,086::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStoragePool(spUUID='b86b687a-d073-497a-ac8a-249025419a3e', hostID=3, remove=False, options=None)
>Thread-13::DEBUG::2014-10-05 21:13:12,086::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`2fa3dc50-ca92-4ec3-a2af-5aff7abc96eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1124' at 'disconnectStoragePool'
>Thread-13::DEBUG::2014-10-05 21:13:12,086::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:13:12,086::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:13:12,086::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.b86b687a-d073-497a-ac8a-249025419a3e`ReqID=`2fa3dc50-ca92-4ec3-a2af-5aff7abc96eb`::Granted request
>Thread-13::DEBUG::2014-10-05 21:13:12,087::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b0df4f54-45da-4726-8dd9-93c91432f990`::_resourcesAcquired: Storage.b86b687a-d073-497a-ac8a-249025419a3e (exclusive)
>Thread-13::DEBUG::2014-10-05 21:13:12,087::task::993::Storage.TaskManager.Task::(_decref) Task=`b0df4f54-45da-4726-8dd9-93c91432f990`::ref 1 aborting False
>Thread-13::DEBUG::2014-10-05 21:13:12,087::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`0a75e7b2-8082-4f72-ba2c-1d8318820fe8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1132' at '_disconnectPool'
>Thread-13::DEBUG::2014-10-05 21:13:12,087::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive'
>Thread-13::DEBUG::2014-10-05 21:13:12,087::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user)
>Thread-13::DEBUG::2014-10-05 21:13:12,087::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`0a75e7b2-8082-4f72-ba2c-1d8318820fe8`::Granted request
>Thread-13::INFO::2014-10-05 21:13:12,087::sp::657::Storage.StoragePool::(disconnect) Disconnect from the storage pool b86b687a-d073-497a-ac8a-249025419a3e
>Thread-15::DEBUG::2014-10-05 21:13:12,818::blockSD::596::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/dev/ff559f46-c495-4f6b-901c-2a624042a050/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None)
>Thread-15::DEBUG::2014-10-05 21:13:12,823::blockSD::596::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712637 s, 5.7 MB/s\n'; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:13:12,946::fileUtils::124::Storage.fileUtils::(cleanupdir) Removing directory: /rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e
>Thread-13::INFO::2014-10-05 21:13:12,946::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::DEBUG::2014-10-05 21:13:12,947::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for c73a3ced-4b41-4b4e-93f7-494d63e7e7ae
>Thread-14::INFO::2014-10-05 21:13:12,947::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae (id: 3)
>Thread-23::INFO::2014-10-05 21:13:12,965::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail
>Thread-23::INFO::2014-10-05 21:13:12,965::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=24']
>Thread-23::DEBUG::2014-10-05 21:13:12,965::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=24 (cwd None)
>Thread-23::DEBUG::2014-10-05 21:13:12,969::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) FAILED: <err> = "/bin/dd: opening `/rhev/data-center/b86b687a-d073-497a-ac8a-249025419a3e/mastersd/dom_md/inbox': No such file or directory\n"; <rc> = 1
>Thread-14::DEBUG::2014-10-05 21:13:14,947::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain c73a3ced-4b41-4b4e-93f7-494d63e7e7ae released successfully (id: 3)
>Thread-13::INFO::2014-10-05 21:13:14,948::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::DEBUG::2014-10-05 21:13:14,948::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for ff559f46-c495-4f6b-901c-2a624042a050
>Thread-15::INFO::2014-10-05 21:13:14,948::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain ff559f46-c495-4f6b-901c-2a624042a050 (id: 3)
>Thread-15::DEBUG::2014-10-05 21:13:16,949::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain ff559f46-c495-4f6b-901c-2a624042a050 released successfully (id: 3)
>Thread-13::DEBUG::2014-10-05 21:13:16,950::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock'
>Thread-13::DEBUG::2014-10-05 21:13:16,950::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:13:16,950::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:13:16,950::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records.
>Thread-13::INFO::2014-10-05 21:13:16,950::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStoragePool, Return response: True
>Thread-13::DEBUG::2014-10-05 21:13:16,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0df4f54-45da-4726-8dd9-93c91432f990`::finished: True
>Thread-13::DEBUG::2014-10-05 21:13:16,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0df4f54-45da-4726-8dd9-93c91432f990`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:13:16,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.b86b687a-d073-497a-ac8a-249025419a3e': < ResourceRef 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', isValid: 'True' obj: 'None'>}
>Thread-13::DEBUG::2014-10-05 21:13:16,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:13:16,951::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e'
>Thread-13::DEBUG::2014-10-05 21:13:16,951::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' (0 active users)
>Thread-13::DEBUG::2014-10-05 21:13:16,951::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e' is free, finding out if anyone is waiting for it.
>Thread-13::DEBUG::2014-10-05 21:13:16,951::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.b86b687a-d073-497a-ac8a-249025419a3e', Clearing records.
>Thread-13::DEBUG::2014-10-05 21:13:16,951::task::993::Storage.TaskManager.Task::(_decref) Task=`b0df4f54-45da-4726-8dd9-93c91432f990`::ref 0 aborting False
>Thread-13::DEBUG::2014-10-05 21:13:17,235::BindingXMLRPC::318::vds::(wrapper) client [10.35.201.227] flowID [31cf314d]
>Thread-13::DEBUG::2014-10-05 21:13:17,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1141465-921f-4633-be83-3bec28de3535`::moving from state init -> state preparing
>Thread-13::INFO::2014-10-05 21:13:17,236::logUtils::44::dispatcher::(wrapper) Run and protect: disconnectStorageServer(domType=3, spUUID='b86b687a-d073-497a-ac8a-249025419a3e', conList=[{'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target1', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf', 'port': '3260'}, {'connection': '10.35.0.98', 'iqn': 'iqn.1994-05.com.redhat:target6', 'user': '', 'tpgt': '1', 'password': '******', 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b', 'port': '3260'}, {'connection': '10.35.16.25', 'iqn': 'iqn.1994-05.com.redhat:nsoffer-target2', 'user': '', 'tpgt': '1', 'password': '******', 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd', 'port': '3260'}], options=None)
>Thread-13::DEBUG::2014-10-05 21:13:17,245::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -r 1 -u (cwd None)
>Thread-13::DEBUG::2014-10-05 21:13:17,968::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:13:17,969::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -r 2 -u (cwd None)
>Thread-13::DEBUG::2014-10-05 21:13:18,629::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:13:18,630::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -r 3 -u (cwd None)
>Thread-13::DEBUG::2014-10-05 21:13:19,285::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:13:19,285::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage)
>Thread-13::DEBUG::2014-10-05 21:13:19,285::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:13:19,285::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan)
>Thread-13::DEBUG::2014-10-05 21:13:19,285::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method
>Thread-13::DEBUG::2014-10-05 21:13:19,285::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds
>Thread-13::DEBUG::2014-10-05 21:13:19,285::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None)
>Thread-13::DEBUG::2014-10-05 21:13:19,293::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::DEBUG::2014-10-05 21:13:19,293::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None)
>Thread-13::DEBUG::2014-10-05 21:13:19,303::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0
>Thread-13::DEBUG::2014-10-05 21:13:19,304::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:13:19,304::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:13:19,304::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:13:19,304::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:13:19,304::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex
>Thread-13::DEBUG::2014-10-05 21:13:19,304::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex
>Thread-13::DEBUG::2014-10-05 21:13:19,304::misc::751::Storage.SamplingMethod::(__call__) Returning last result
>Thread-13::INFO::2014-10-05 21:13:19,304::logUtils::47::dispatcher::(wrapper) Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:13:19,305::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1141465-921f-4633-be83-3bec28de3535`::finished: {'statuslist': [{'status': 0, 'id': 'af150e8e-4d74-4810-b8bf-0c6a19637dbf'}, {'status': 0, 'id': 'e8d58651-6414-4fc2-b281-2141cc97829b'}, {'status': 0, 'id': '8f399b5f-1237-479e-82e6-eedb202b66fd'}]}
>Thread-13::DEBUG::2014-10-05 21:13:19,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1141465-921f-4633-be83-3bec28de3535`::moving from state preparing -> state finished
>Thread-13::DEBUG::2014-10-05 21:13:19,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {}
>Thread-13::DEBUG::2014-10-05 21:13:19,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {}
>Thread-13::DEBUG::2014-10-05 21:13:19,305::task::993::Storage.TaskManager.Task::(_decref) Task=`e1141465-921f-4633-be83-3bec28de3535`::ref 0 aborting False

Actions: View

Attachments on bug 1149517: 944065 | 944066 | 944067 | 944068